{"id":1057,"date":"2015-12-05T17:34:11","date_gmt":"2015-12-05T22:34:11","guid":{"rendered":"https:\/\/madameshepard.com\/?p=1057"},"modified":"2015-12-05T17:34:11","modified_gmt":"2015-12-05T22:34:11","slug":"using-cartoons-to-assess-interpretive-listening-with-novice-learners","status":"publish","type":"post","link":"https:\/\/madameshepard.com\/?p=1057","title":{"rendered":"Using Cartoons to Assess Interpretive Listening with Novice Learners"},"content":{"rendered":"<p><a href=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1062\" src=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full-248x300.jpg\" alt=\"COUV. La Balle.indd\" width=\"248\" height=\"300\" srcset=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full-248x300.jpg 248w, https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full.jpg 430w\" sizes=\"auto, (max-width: 248px) 100vw, 248px\" \/><\/a><\/p>\n<p>This week\u2019s #langchat discussion about interpretive listening revealed that we language teachers are very diverse in the way we approach this skill, especially with novice learners. Although I reflected at length on the topic of assessing listening in an <a href=\"https:\/\/madameshepard.com\/?p=653\">earlier post,<\/a> I\u2019d like to specifically address a few of the questions that came up during Thursday night\u2019s discussion.<\/p>\n<p><strong>Question #1: What resources are appropriate for novice learners?<\/strong> While some teachers are hesitant to use authentic resources with early novices, I have found that first semester French 1 students can successfully interpret carefully selected authentic materials when given level-appropriate tasks.\u00a0 My go-to resource for these students are cartoon videos for the following reasons:<\/p>\n<ol>\n<li>These videos were made for novice language learners\u2014young children in the target culture! As a result, the vocabulary and sentence structures are relatively simple and the linguistic input is supported by strong visual cues. This is exactly what our novice learners need.<\/li>\n<li>The wide selection of these videos ensures that there are several choices available for any theme we\u2019ve included in our novice curriculum. My favorites for my Level 1 and 2 students are <em>Trotro, Petit Ours Brun <\/em>and <em>T\u2019choupi et Doudou,<\/em> because of the broad range of topics covered and the comprehensibility. I also occasionally use <em>Peppa Pig<\/em> with my level 2 students. Although originally recorded in (British) English, the French translation was clearly intended for French-speaking children, so I do consider these to be authentic resources.\u00a0 However, the target culture would not, of course, be represented in these videos.<\/li>\n<li>Cartoons are very engaging to my students. They look forward to their turn at the computer and a few students have even mentioned that they have watched additional episodes of the series at home, \u201cjust for fun.\u201d<\/li>\n<li>As authentic resources, these cartoon videos often integrate cultural products, practices and perspectives of the target culture. When Petit Ours Brun puts his shoes under the Christmas tree, his grandfather comments on the delicious turkey, and he wakes up to presents on Christmas morning, my students learn relevant cultural practices regarding Christmas celebrations in France.<\/li>\n<\/ol>\n<p><strong>Question #2: What types of tasks are appropriate for novice learners? <\/strong>I realized as I participated in Thursday night\u2019s #langchat that I have interpreted ACTFL\u2019s descriptors regarding interpretive listening differently than many of my colleagues. The Novice Mid (my goal for level 1) NCSSFL-ACTFL Can-Do Benchmark for interpretive listening reads, \u201cI can recognize some familiar words and phrases when I hear them spoken.\u201d\u00a0 If I understood my colleagues\u2019 responses correctly, many of us may be assessing listening by having students list the words and phrases that they hear.\u00a0 Because it isn\u2019t clear to me how this type of task would demonstrate interpretation\/comprehension, I ask students to answer questions to show comprehension of the video, but phrase these questions in a way that the students can use previously-learned words\/phrases (along with visual context clues) to respond.\u00a0 This year I am using a multiple choice format for my formative listening assessments using our district\u2019s recently-adopted Canvas learning management system.\u00a0 Although I don\u2019t feel that multiple choice is appropriate for many language tasks, this platform has the advantage of providing immediate feedback to my students.\u00a0 In addition, since creating and assessing them requires a minimal time commitment on my part, I am able to provide more opportunities for listening than I was using other task types.\u00a0 Lastly, this format provides students with additional context clues.\u00a0 Their listening is more purposeful as they are listening for a specific response, as well as to eliminate distractors. While I typically use open-ended question types on my IPA\u2019s, these multiple choice quizzes, which the students complete individually at a computer, provide the majority of my formative listening assessments.<\/p>\n<p>In order to save time, I create these quizzes directly in Canvas, which unfortunately makes them very difficult to share.\u00a0 For the purposes of this discussion, I\u2019ve uploaded a <a href=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/trotro-questions.docx\">Word documen<\/a>t of screenshots from a quiz I made this morning for the video, <em>Trotro et les cadeaux de Noel <\/em>(<a href=\"https:\/\/www.youtube.com\/watch?v=iRcv1pVaitY\">https:\/\/www.youtube.com\/watch?v=iRcv1pVaitY<\/a> ). As this document shows, the questions that I\u2019ve created enable these Novice Low-Mid students to demonstrate their ability to interpret this text using only previously-learned words and phrases and visual clues. While most of the items assess literal comprehension, I\u2019ve included a few questions that require the students to make inferences and guess the meanings of new words using context clues. Here\u2019s a quick explanation of my thought process for each question.<\/p>\n<p><strong>#1:<\/strong> While each of these questions would be appropriate to the context, my students will probably understand \u201cpour moi\u201d when they hear it.\u00a0 They will also be able to eliminate the 2<sup>nd<\/sup> choice, because they know the word for Santa.\u00a0 Although I\u2019ve used the other question words in class, the students are not using them yet.\u00a0 I included them in the distractors to encourage the students to start thinking about how questions are asked.<\/p>\n<p><strong>#2:<\/strong> This question is a \u201cgimme.\u201d\u00a0 The students know the word for book and have visual clues as further support.\u00a0 I created the question to improve the students\u2019 confidence, enable all students to have some \u201ccorrect\u201d answers, and to provide more context for further questions.\u00a0 As you can see, I write LOTS of questions, because I find the questions themselves provide important context and help the students follow along with the video.<\/p>\n<p><strong>#3:<\/strong> \u201cChouette\u201d is a new word for these students, but it appears in a lot of children\u2019s literature\/videos and I think they\u2019ll enjoy using it.\u00a0 The context should make the meaning of this word clear.<\/p>\n<p><strong>#4\/#5<\/strong>: The students have learned the word \u201cjeux-video\u201d so I think they\u2019ll get \u201cjeu.\u201d\u00a0 Also because Trotro also uses \u201cjouer\u201d I think they\u2019ll understand it\u2019s something to play with rather than listen to.<\/p>\n<p><strong>#6\/#7<\/strong> Students can answer by recognizing the previously-learned words \u201cgros\u201d and \u201cbelle.\u201d<\/p>\n<p><strong>#8:<\/strong> Although this question does not assess listening comprehension (the word appears in written form), it does provide a contextualized way to introduce a new vocabulary word.<\/p>\n<p><strong>#9:<\/strong> The students can listen for the word \u201ccontent\u201d as well as eliminate the distractors based on previously-learned words.<\/p>\n<p><strong>#10:<\/strong> The students have heard \u201cmaintenant\u201d repeatedly, but it hasn\u2019t been formally introduced.\u00a0 If they don\u2019t recognize it, they should still be able to eliminate the other choices.<\/p>\n<p><strong>#11: <\/strong>Although the students will not understand the entire sentence in which it appears, they should be able to answer this question by identifying the word \u201ccadeaux.\u201d<\/p>\n<p><strong>#12<\/strong>: I\u2019m curious what my students will do with this inference-based question.\u00a0 They should recognize the phrase, \u201cMoi, aussi\u201d which should enable them to infer that Boubou got the same gift.<\/p>\n<p><strong>#13:<\/strong> The students should recognize the word \u201cjouer\u201d as well as be able to eliminate the distractors based on previously-learned vocabulary.<\/p>\n<p><strong>#14:<\/strong> The students should be able to use the visual context to guess the meaning of this new vocabulary.<\/p>\n<p><strong>#15:<\/strong> The phrase \u201cc\u2019est moi\u201d should enable the students to choose the correct response for this one. As with several other items, I\u2019ve included the transcription of the entire sentence to introduce new vocabulary\u2014the verb \u201cgagner.\u201d<\/p>\n<p><strong>#16:<\/strong> Although my students won\u2019t be able to use the linguistic content to answer this question, I\u2019ve included it to encourage inference based on visual context clues.<\/p>\n<p><strong>#17:<\/strong> I\u2019ll be curious how they do with this one.\u00a0 \u201cBateau\u201d is an unknown word and although they\u2019ve seen \u201cmer,\u201d I\u2019m not sure they\u2019ll pick up on it.\u00a0 Some might pick out \u201cpirate\u201d but I\u2019ll be curious how many are able to answer this one correctly.<\/p>\n<p><strong>#18:<\/strong> The students have heard \u201crigolo\u201d and this word even appears in Trotro\u2019s theme song.\u00a0 In addition, they should be able to eliminate the distractors based on previously-learned vocabulary.<\/p>\n<p>While there\u2019s nothing especially innovative about this assessment format, after completing many similar tasks during their first semester of language study most of my level 1 students are pretty accurate when completing this type of formative assessment.<\/p>\n<p><strong>Question #3: How should interpretive listening be assessed? <\/strong>I did want to make a point about grading these formative assessments.\u00a0 Although I do my best to create questions that are mostly at the students\u2019 current proficiency level, with a few items thrown in to encourage \u201cstretch,\u201d I rely heavily on my students\u2019 results to determine how close I came to hitting this target.\u00a0 Therefore, I do not decide how to grade these assessments until I have data on how the class scored as a whole.\u00a0 In other words, this particular formative assessment will not necessarily by worth 18 points.\u00a0 If, for example, the highest score is 16, I might make this the maximum score. For teachers that do not record a score on formative assessments, this isn\u2019t an issue of course.\u00a0 I only suggest that we expect and allow for student errors when assessing interpretive listening (even using objective evaluations) just as we do when assessing the other modes.<\/p>\n<p>I\u2019d love to hear from any of you who are willing to share your experiences and ideas about assessing listening with novice learners!<\/p>\n<p>Image credit: www.gallimard-jeunesse.fr<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week\u2019s #langchat discussion about interpretive listening revealed that we language teachers are very diverse in the way we approach this skill, especially with novice learners. Although I reflected at length on the topic of assessing listening in an earlier post, I\u2019d like to specifically address a few of the questions that came up during [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_wp_convertkit_post_meta":{"form":"-1","landing_page":"0","tag":"0","restrict_content":"0"},"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[3,20,14,21],"tags":[],"class_list":["post-1057","post","type-post","status-publish","format-standard","hentry","category-assessment","category-french-1-units","category-french-3-units","category-noel"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/madameshepard.com\/?p=1057\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings\" \/>\n<meta property=\"og:description\" content=\"This week\u2019s #langchat discussion about interpretive listening revealed that we language teachers are very diverse in the way we approach this skill, especially with novice learners. Although I reflected at length on the topic of assessing listening in an earlier post, I\u2019d like to specifically address a few of the questions that came up during [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/madameshepard.com\/?p=1057\" \/>\n<meta property=\"og:site_name\" content=\"Madame&#039;s Musings\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/shepardwlconsulting\" \/>\n<meta property=\"article:published_time\" content=\"2015-12-05T22:34:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full-248x300.jpg\" \/>\n<meta name=\"author\" content=\"madameshepard\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"madameshepard\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/madameshepard.com\/#website\",\"url\":\"https:\/\/madameshepard.com\/\",\"name\":\"Madame&#039;s Musings\",\"description\":\"A site about proficiency-based world language instruction\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/madameshepard.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/madameshepard.com\/?p=1057\",\"url\":\"https:\/\/madameshepard.com\/?p=1057\",\"name\":\"Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings\",\"isPartOf\":{\"@id\":\"https:\/\/madameshepard.com\/#website\"},\"datePublished\":\"2015-12-05T22:34:11+00:00\",\"dateModified\":\"2015-12-05T22:34:11+00:00\",\"author\":{\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511\"},\"breadcrumb\":{\"@id\":\"https:\/\/madameshepard.com\/?p=1057#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/madameshepard.com\/?p=1057\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/madameshepard.com\/?p=1057#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/madameshepard.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Using Cartoons to Assess Interpretive Listening with Novice Learners\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511\",\"name\":\"madameshepard\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/madameshepard.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g\",\"caption\":\"madameshepard\"},\"sameAs\":[\"http:\/\/shepardwlconsultant.com\",\"https:\/\/www.facebook.com\/shepardwlconsulting\",\"https:\/\/twitter.com\/mmeshep\"],\"url\":\"https:\/\/madameshepard.com\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/madameshepard.com\/?p=1057","og_locale":"en_US","og_type":"article","og_title":"Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings","og_description":"This week\u2019s #langchat discussion about interpretive listening revealed that we language teachers are very diverse in the way we approach this skill, especially with novice learners. Although I reflected at length on the topic of assessing listening in an earlier post, I\u2019d like to specifically address a few of the questions that came up during [&hellip;]","og_url":"https:\/\/madameshepard.com\/?p=1057","og_site_name":"Madame&#039;s Musings","article_author":"https:\/\/www.facebook.com\/shepardwlconsulting","article_published_time":"2015-12-05T22:34:11+00:00","og_image":[{"url":"https:\/\/madameshepard.com\/wp-content\/uploads\/2015\/12\/Trotro-4_image_full-248x300.jpg"}],"author":"madameshepard","twitter_misc":{"Written by":"madameshepard","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/madameshepard.com\/#website","url":"https:\/\/madameshepard.com\/","name":"Madame&#039;s Musings","description":"A site about proficiency-based world language instruction","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/madameshepard.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/madameshepard.com\/?p=1057","url":"https:\/\/madameshepard.com\/?p=1057","name":"Using Cartoons to Assess Interpretive Listening with Novice Learners - Madame&#039;s Musings","isPartOf":{"@id":"https:\/\/madameshepard.com\/#website"},"datePublished":"2015-12-05T22:34:11+00:00","dateModified":"2015-12-05T22:34:11+00:00","author":{"@id":"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511"},"breadcrumb":{"@id":"https:\/\/madameshepard.com\/?p=1057#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/madameshepard.com\/?p=1057"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/madameshepard.com\/?p=1057#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/madameshepard.com\/"},{"@type":"ListItem","position":2,"name":"Using Cartoons to Assess Interpretive Listening with Novice Learners"}]},{"@type":"Person","@id":"https:\/\/madameshepard.com\/#\/schema\/person\/6fa1e130e8d5cc1a39785d34c4d9e511","name":"madameshepard","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/madameshepard.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6f083cd3ae4a04748bdda0fb59317df561dcd16a2c20402758e71939c643d0a0?s=96&d=mm&r=g","caption":"madameshepard"},"sameAs":["http:\/\/shepardwlconsultant.com","https:\/\/www.facebook.com\/shepardwlconsulting","https:\/\/twitter.com\/mmeshep"],"url":"https:\/\/madameshepard.com\/?author=1"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p4SSyG-h3","_links":{"self":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/1057","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1057"}],"version-history":[{"count":4,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/1057\/revisions"}],"predecessor-version":[{"id":1063,"href":"https:\/\/madameshepard.com\/index.php?rest_route=\/wp\/v2\/posts\/1057\/revisions\/1063"}],"wp:attachment":[{"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1057"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1057"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/madameshepard.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1057"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}