{"id":653,"date":"2015-05-31T09:09:48","date_gmt":"2015-05-31T13:09:48","guid":{"rendered":"https:\/\/madameshepard.com\/?p=653"},"modified":"2015-05-31T09:09:48","modified_gmt":"2015-05-31T13:09:48","slug":"musings-on-assessing-interpretive-listening","status":"publish","type":"post","link":"https:\/\/madameshepard.com\/?p=653","title":{"rendered":"Musings on Assessing Interpretive Listening"},"content":{"rendered":"

\"listening\"<\/a>A couple of weeks ago I shared my thoughts about assessing interpretive reading.\u00a0 In that post <\/a>gave my opinion \u00a0that ACTFL\u2019s IPA Template<\/a> was a generally effective way to design an assessment of reading comprehension and that, with a couple of modifications, their rubric <\/a>was well-aligned with the tasks on the template. I have reservations, however, about the use of the ACTFL IPA template to assess listening.\u00a0 Here are a couple of my thoughts about assessing listening, please share yours!<\/p>\n

Assessing Interpretive Listening is Important<\/strong><\/p>\n

By defining both listening and reading comprehension as Interpretive Communication, ACTFL has given us an out when writing IPA\u2019s.\u00a0 We can choose to include either one, but are not required to include both.\u00a0\u00a0 My guess is that when given the choice, most of us are choosing authentic written rather than recorded texts for the interpretive portion of our IPA\u2019s.\u00a0 There are several good reasons why this may be the case.<\/p>\n

    \n
  1. Authentic written texts are usually relatively easy to find. A quick Google search of our topic + Infographie will often produce a content-filled, culturally-rich text with the visual support that Novice learners need. Picture books, ads, social media posts, etc. provide additional resources. \u00a0For our Intermediate students, our options are even greater as their proficiency allows them to read a wider variety of short texts, an unlimited supply of which are quickly located online.<\/li>\n
  2. Written texts can be easily evaluated regarding their appropriateness for our interpretive assessment tasks. A quick skim will reveal whether a text being considered contains the targeted language and structures, culturally-relevant content, and appropriate visual support that we are looking for.<\/li>\n
  3. Assessments of interpretive reading are easy to administer. We need only a Xerox machine to provide a copy of the text to each student, who can then complete the interpretive task at her own pace. When a student is absent, we can simply hand him a copy of the text and interpretive activity and he can complete the task in a corner of the room or any other area of the building where make-ups are administered.<\/li>\n<\/ol>\n

    Curating oral texts and assessing their interpretation, however, is considerably more time-consuming.\u00a0 While we have millions of videos available to us on YouTube (my person go-to for authentic listening texts), videos cannot be skimmed like written texts.\u00a0 We actually have to listen to the videos that our searches produce in order to evaluate whether they are appropriate to the proficiency of the students for whom they are intended.\u00a0 In some cases, we have to listen to dozens of videos before finding that gem that contains the appropriate vocabulary, cultural content and visual support that our learners need.\u00a0 When it comes to administering these assessments, we often face additional challenges.\u00a0 In my school, YouTube is blocked on student accounts.\u00a0 Therefore, I have to log into 30 computers in a lab (which is seldom available) or my department\u2019s class set of IPads (sometimes available) for all of my students to individually complete a listening assessment at the same time. While many of us play and project our videos to the class as a whole, I think this places an undue burden on our Novice students who \u201crequire repetition, rephrasing, and\/or a slowed rate of speech for comprehension\u201d (ACTFL Proficiency Guidelines, 2012).<\/em> A student who has her own device can pause and rewind when needed, as well as slow the rate of speech when appropriate technology is available.<\/p>\n

    In spite of these challenges to evaluating listening comprehension, I think we have a responsibility to assess our students\u2019 ability to interpret oral texts. As Dave Burgess said at a conference I recently attended, \u201cIt\u2019s not supposed to be easy, it\u2019s supposed to be worth it.\u201d\u00a0 Assessing interpretive listening skills IS worth it. As the adage says, \u201cwe teach what we test.\u201d\u00a0 If we are not evaluating listening, we are not teaching our students what they need to comprehend and participate in verbal exchanges with members of the target culture.\u00a0 While technology may allow us to translate a written text in nanoseconds, no app can allow us to understand an unexpected public announcement or participate fully in a natural conversation with a native speaker. In my opinion, our assessment practices are not complete if we are not assessing listening comprehension to the same extent as reading comprehension. As a matter of fact, I include separate categories for each of these skills in my electronic gradebook.\u00a0 While others may separate grades according to modes of communication, I\u2019m not sure this system provides as much information regarding student progress toward proficiency. Although both reading and listening may require interpretation of a text, they are clearly vastly different skills.\u00a0 Students who are good readers are not necessarily good listeners, and vice versa. In their Proficiency Guidelines<\/a>, <\/em>ACTFL clearly differentiates these two skills, don\u2019t we need to do the same when evaluating our students using an IPA?<\/p>\n

    Designing Valid Interpretive Listening Assessments is Difficult<\/strong><\/p>\n

    \u00a0<\/strong>In my opinion, ACTFL has provided us very little direction in assessing interpretive listening.\u00a0 While we are advised to use the same IPA Interpretive template, I find that many of these tasks do not effectively assess listening comprehension. Consider the following:<\/p>\n

    Key Words. <\/strong>While students can quickly skim a written text to find key words, the same is not true of recorded texts.\u00a0 Finding isolated key words requires listening to the video multiple times and attempting to isolate a single word in a sentence.\u00a0 I find this task needlessly time-consuming, as I will be assessing literal comprehension in other tasks.\u00a0 Furthermore, this task puts some students, especially those with certain learning disabilities at a significant disadvantage.\u00a0 Many of these students have excellent listening comprehension, but are not able to accurately transfer what they understand aurally into written form.<\/p>\n

    Main Idea. <\/strong>Although this task seems fairly straightforward, I question its validity in assessing comprehension for Novice and Intermediate learners. According to the ACTFL Proficiency Guidelines, Novice-level listeners are \u201clargely dependent on factors other than the message itself\u201d and Intermediate listeners \u201crequire a controlled listening environment where they hear what they may expect to hear.\u201d\u00a0 This means that all of my students will be highly dependent on the visual content of the videos I select to ascertain meaning.\u00a0 Therefore, any main idea they provide will most likely be derived from what the students see rather than what they hear.\u00a0 A possible solution might be for the teacher to provide a series of possible main ideas (all of which could be extrapolated from the visual information) and have the students choose the best one.\u00a0 However, this task would certainly be unrealistic for our novice learners who are listening at word level.<\/p>\n

    Supporting Details.\u00a0 <\/strong>I think this task on the IPA template is the most effective in providing us feedback regarding our students\u2019 ability to understand a recorded text.\u00a0 By providing a set of details which may be mentioned, we provide additional context to help our students understand the text and by requiring them to fill in information we are assessing their literal comprehension of what they hear.\u00a0 In addition, this type of task can easily be adjusted to correspond to the proficiency level of the students. Providing information to support the detail, \u201cCaillou\u2019s age\u201d for example, is a realistic expectation for a novice listener who is watching a cartoon.<\/p>\n

    Organizational Features <\/strong>While I see little value in this task for interpretive reading, I see even less for listening.\u00a0 As previously mentioned, even intermediate listeners need to be assessed using straightforward texts so that they can anticipate the information they will hear.\u00a0 Having my students describe the organization of a recorded text would not provide additional information about their comprehension.<\/p>\n

    Guessing meaning from context. <\/strong>As much as I value this task on reading assessments, I do not find it to be a valid means of assessing aural comprehension.\u00a0 The task requires the teacher to provide a sentence from the text and then guess at the meaning of an underlined word.\u00a0 As soon as I provide my students with a written sentence, the task becomes an assessment of their ability to read this sentence, rather than understand it aurally. \u00a0\u00a0\u00a0\u00a0\u00a0 <\/strong><\/p>\n

    Inferences <\/strong>As with the main idea, I think Novice and Intermediate listeners will be overly dependent on visual cues to provide inferences.\u00a0 While I believe students should be taught to use context to help provide meaning, I prefer to assess what they are actually able to interpret verbally. ACTFL does suggest providing multiple choice inferences in the IPA template, but again the teacher would have to provide choices whose plausibility could not be derived from visual information in order to isolate listening comprehension.<\/p>\n

    Author\u2019s Perspective. <\/strong>While I regularly include author\u2019s perspective items on my assessments for my AP students, I feel this is an unrealistic task for Novice and Intermediate Low listeners.\u00a0 Students who are able to understand words, phrases, and sentence-length utterances will most likely be unable to identify an author\u2019s perspective using only the verbal content of a video.<\/p>\n

    Cultural Connections. <\/strong>Authentic videos are one of the best tools we have for providing cultural content to our students.\u00a0 The content provided by the images is more meaningful, memorable, and complete than any verbal information could be.\u00a0 However, once again it is difficult to isolate the verbal content from the visual, creating a lack of validity for assessment purposes.<\/p>\n

    \u00a0<\/strong>Conclusion<\/strong><\/p>\n

    For now, I\u2019m planning on using supporting detail or simple comprehension questions when formally assessing my students\u2019 interpretive listening skills in order to ensure that I am testing what I intend to test. When practicing these interpretive skills, however, I plan on including some of the other tasks from the IPA template in order to fully exploit the wealth of information that is included in authentic videos. \u00a0I\u2019m looking forward to hearing from you about how you assess your students on interpretive listening!<\/p>\n","protected":false},"excerpt":{"rendered":"

    A couple of weeks ago I shared my thoughts about assessing interpretive reading.\u00a0 In that post gave my opinion \u00a0that ACTFL\u2019s IPA Template was a generally effective way to design an assessment of reading comprehension and that, with a couple of modifications, their rubric was well-aligned with the tasks on the template. I have reservations, […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_wp_convertkit_post_meta":{"form":"-1","landing_page":"0","tag":"0","restrict_content":"0"},"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,23,22],"tags":[],"class_list":["post-653","post","type-post","status-publish","format-standard","hentry","category-assessment","category-integrated-performance-assessments-ipas","category-musings"],"yoast_head":"\nMusings on Assessing Interpretive Listening - Madame's Musings<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/madameshepard.com\/?p=653\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Musings on Assessing Interpretive Listening - Madame's Musings\" \/>\n<meta property=\"og:description\" content=\"A couple of weeks ago I shared my thoughts about assessing interpretive reading.\u00a0 In that post gave my opinion \u00a0that ACTFL\u2019s IPA Template was a generally effective way to design an assessment of reading comprehension and that, with a couple of modifications, their rubric was well-aligned with the tasks on the template. I have reservations, […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/madameshepard.com\/?p=653\" \/>\n<meta property=\"og:site_name\" content=\"Madame's Musings\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/shepardwlconsulting\" \/>\n<meta property=\"article:published_time\" content=\"2015-05-31T13:09:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/05\/listening.jpg\" \/>\n<meta name=\"author\" content=\"madameshepard\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"madameshepard\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/madameshepard.com\/#website\",\"url\":\"https:\/\/madameshepard.com\/\",\"name\":\"Madame's Musings\",\"description\":\"A site about proficiency-based world language instruction\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/madameshepard.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/madameshepard.com\/?p=653\",\"url\":\"https:\/\/madameshepard.com\/?p=653\",\"name\":\"Musings on Assessing Interpretive Listening - Madame's Musings\",\"isPartOf\":{\"@id\":\"https:\/\/madameshepard.com\/#website\"},\"datePublished\":\"2015-05-31T13:09:48+00:00\",\"dateModified\":\"2015-05-31T13:09:48+00:00\",\"author\":{\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511\"},\"breadcrumb\":{\"@id\":\"https:\/\/madameshepard.com\/?p=653#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/madameshepard.com\/?p=653\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/madameshepard.com\/?p=653#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/madameshepard.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Musings on Assessing Interpretive Listening\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511\",\"name\":\"madameshepard\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g\",\"caption\":\"madameshepard\"},\"sameAs\":[\"http:\/\/shepardwlconsultant.com\",\"https:\/\/www.facebook.com\/shepardwlconsulting\",\"https:\/\/twitter.com\/mmeshep\"],\"url\":\"https:\/\/madameshepard.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Musings on Assessing Interpretive Listening - Madame's Musings","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/madameshepard.com\/?p=653","og_locale":"en_US","og_type":"article","og_title":"Musings on Assessing Interpretive Listening - Madame's Musings","og_description":"A couple of weeks ago I shared my thoughts about assessing interpretive reading.\u00a0 In that post gave my opinion \u00a0that ACTFL\u2019s IPA Template was a generally effective way to design an assessment of reading comprehension and that, with a couple of modifications, their rubric was well-aligned with the tasks on the template. I have reservations, […]","og_url":"https:\/\/madameshepard.com\/?p=653","og_site_name":"Madame's Musings","article_author":"https:\/\/www.facebook.com\/shepardwlconsulting","article_published_time":"2015-05-31T13:09:48+00:00","og_image":[{"url":"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/05\/listening.jpg"}],"author":"madameshepard","twitter_misc":{"Written by":"madameshepard","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/madameshepard.com\/#website","url":"https:\/\/madameshepard.com\/","name":"Madame's Musings","description":"A site about proficiency-based world language instruction","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/madameshepard.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/madameshepard.com\/?p=653","url":"https:\/\/madameshepard.com\/?p=653","name":"Musings on Assessing Interpretive Listening - Madame's Musings","isPartOf":{"@id":"https:\/\/madameshepard.com\/#website"},"datePublished":"2015-05-31T13:09:48+00:00","dateModified":"2015-05-31T13:09:48+00:00","author":{"@id":"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511"},"breadcrumb":{"@id":"https:\/\/madameshepard.com\/?p=653#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/madameshepard.com\/?p=653"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/madameshepard.com\/?p=653#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/madameshepard.com\/"},{"@type":"ListItem","position":2,"name":"Musings on Assessing Interpretive Listening"}]},{"@type":"Person","@id":"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511","name":"madameshepard","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/madameshepard.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g","caption":"madameshepard"},"sameAs":["http:\/\/shepardwlconsultant.com","https:\/\/www.facebook.com\/shepardwlconsulting","https:\/\/twitter.com\/mmeshep"],"url":"https:\/\/madameshepard.com\/?author=1"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4SSyG-ax","_links":{"self":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/653","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=653"}],"version-history":[{"count":3,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/653\/revisions"}],"predecessor-version":[{"id":657,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/653\/revisions\/657"}],"wp:attachment":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=653"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=653"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=653"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}