Tag Archives: iPA

7 Steps to Creating an Integrated Performance Assessment (IPA)

yayAlthough I am embarrassed to admit it, I had never heard of an IPA (or IP-Yay, as one of my classes calls them) until May, 2013 when I attended a presentation by my state’s foreign language association.  Because our state was including a student progress measure on our teacher evaluation system for the first time, our association took an active role in encouraging us to use a measurement of student proficiency, rather than as assessment of vocabulary/grammatical accuracy to document our students’ learning.  Although I had been somewhat familiar with various proficiency descriptors, I had never designed my instruction to increase and assess student proficiency until attending this important session.  However, as the result of this presentation and two others that I subsequently attended, I made dramatic changes to my instructional and assessment strategies in order to encourage student proficiency, rather than simply grammar and vocabulary accuracy.  While I read what I found online about IPA’s, I did not have a good overall understanding of the specifics of this type of assessment until I finally stumbled across the manual found here: http://www.actfl.org/publications/guidelines-and-manuals/implementing-integrated-performance-assessment .  While I make some modifications based on my own teaching situation and students’ needs, I have relied heavily on this manual when developing my own assessments.  However, I am no expert in this process and have not received any specific ACTFL training.  The ideas expressed here reflect only my current understanding of proficiency-based assessment.  What I can say for sure is that the transition from traditional tests to IPA’s, has improved student learning in my classes more than any other change I’ve made during my 25 year teaching career.

Based on my own experience, here are the steps that I suggest when designing an IPA:

  1. Decide what you want to assess. Based on the principle of backwards design, writing the summative assessment is one of the very first steps in developing a unit plan. Therefore, I write my IPA before developing any of my lesson plans for the unit. I recently heard a speaker say, “You teach what you test.”  While this seemed counter-intuitive to me at first, as I thought about it more it made perfect sense.  When we choose how to assess our students, we are demonstrating what we wanted them to learn. If it’s not on the “test,” we probably didn’t think it was that important.  In a proficiency-based classroom, that means that we assess our students’ ability to communicate across the modes of communication.  So, the first step in designing an IPA is to choose a benchmark for each mode based on the ACTFL Can-Do Statements (http://www.actfl.org/global_statements ). Note: The bold print statement is the benchmark, and the statements which follow (preceded by a box) are examples.  Sometimes I choose one of the examples, but other times I create my own based on the theme I have chosen for my unit.

 

  1. Choose an authentic written text. Based on the interpretive reading benchmark I have chosen, I find an authentic, culturally-rich text that will enable the students to demonstrate that they have achieved the benchmark. The type of text that will be appropriate depends on the proficiency-level of the students. Novice learners are highly dependent on using visuals when interpreting so I use infographics, picture books, brochures, catalogues, or comic strips for these students.  Note: Try using Google Images, rather than just Google when searching for texts for these students. Here are some other resources I use for Novice learners:

http://www.iletaitunehistoire.com/genres/documentaires

https://www.envolee.com/fr/catalogue/1/8-du-plaisir-a-lire (Although there is a fee for downloading these texts, I have found this to be money well spent.)

http://www.scholastic.ca/education/envol_en_litteratie/downloadablebooks.html (Also worth the fee)

 

While Intermediate Low to Mid learners are able to interpret lengthier texts, they are often unable to understand authentic texts written for their developmental age (in language programs that begin in high school).   These students usually enjoy tapping into their “inner child” by reading magazine articles and online material written for younger students. I find it helpful to use a children’s search engine when researching materials for these students.  Here are a few that I’ve used:

 

http://www.takatrouver.net/takamag/index.php

http://www.coolgo.fr/

http://www.kidadoweb.com/

http://www.lespagesjuniors.com/

http://www.webjunior.net/

 

When possible, I use articles from authentic children’s magazines for interpretive tasks. These materials are often more visually rich than online materials. I have found several relevant articles for French 2 students in Astrapi, while I prefer Okapi for my French 3 students. My level 4/5 students are able to interpret the texts written for teenagers in Phosphore.

 

  1. Write the interpretive reading task. Once I have chosen the authentic text, I write the actual assessment based on the template found here: http://www.actfl.org/publications/guidelines-and-manuals/implementing-integrated-performance-assessment . While I think the template is self-explanatory, I thought I’d share a few tips for each section.

#1: I write the Key Word Recognition section by typing about the English translation of about 10 words/phrases from the text that I think the students will already know, based on prior instruction or the activities in the unit being assessed. Note: Sometimes I “cheat” here to introduce a new vocabulary word that the students will need in order to interpret the text.  I do so by writing the entire phrase in which the word appears.  When searching for the phrase in the text, they will be able to use the context to determine the meaning of the targeted vocabulary item.

#2: Main Idea.  Most of my students don’t write the main idea until they have completed the Supporting Details section. It would probably make sense to move this section accordingly when typing an IPA.  When assigning a literary text, I change the wording here so that the students are writing a 2-3 sentence summary, rather than a main idea.

#3: Supporting Details. This is the core section of the task, where students will really have a chance to show you what they know. Remember that these are statements, not questions.  The students are not providing answers, they’re writing details to show that they understood more than the main idea the text.  I try to give them a chance to really show off here by writing very general statements, so that they can use as many details as possible.  Although the template suggests writing 8 statements (3 of which will be distractors) I often write more based on the length of the text.  I have noticed that I often learn more about my students’ comprehension from their errors on the distractors than on the details they provide for the “correct” statements.  Because most of my texts are informational in nature, the students can use their background knowledge to provide logical answers, without actually understanding the text.  However, when they provide a detail for a distractor, I know that they are using what they know rather than what they’ve read.  Note: I generally omit the requirement that the students “write the letter of the detail next to where it appears in the text.”  I did not find that this step was difficult to assess and didn’t supply me with any additional information about what the students understood.

#4: Organizational Features.  In the interest of full disclosure, I have to admit that I sometimes omit this section.  While I recognize that identifying the organizational structure is an important top-down process, I do not feel that assessing this skill provides much additional information about the students’ comprehension of a text.  For novice learners who are interpreting infographics or other simple texts, the organization is so obvious that the students often see this step as needless busywork.

#5: Guessing Meaning from Text.  My students consistently score the lowest on this section of the interpretive task.  As suggested in the ACTFL manual, I type the entire sentence in which the word is located, as well as provide a description of where in the text the sentence is located.  The students’ often respond with an English word that is similar in spelling, but not meaning to the French word.  This indicates to me that they are not using the context clues to infer the meaning of the word.  Because of the difficulty of this task, I usually include more than three items in this section so that students have a greater opportunity for success.  In addition, I’ll continue to encourage them to rely more on context for these items.

#6: Inferences. The ACTFL template gives great examples of appropriate inference tasks.  Make sure to note that for novice learners it’s appropriate to give a choice of possible inferences and have the students choose which one is supported by the text and provide justification.  When I began using this template, I was pleasantly surprised by how much this section demonstrates the depth of the students’ comprehension.

#7: Author’s Perspective. While I think this task is very important for my upper level students, it is often not applicable for the types of texts that Novice learners read.  Although I suppose we could say that the perspective of the “author” of a menu is that the food is delicious, I don’t think requiring the students to explain this is a good use of their time or mine.

#8: Comparing Cultural Perspectives. I again rely heavily on the suggestions given in the ACTFL template for this task.  I have found, however, that the students need more specific directions for this section.  For example, I have had to explain that “It would be written in English.” Is not an acceptable response to the question regarding how the article would be different if it was written for an American audience.  I have also been quite liberal in the type of answer that might demonstrate a perspective, rather than just a product or practice.  While this distinction is an important one, Novice learners are sometimes not able to even identify the relationship between practices and perspectives in their own culture, let alone a culture about which they know very little.

#9: Personal Reaction. I generally omit this section from the interpretive task.  Because the instructions state that the response should be in the target language, I consider it a presentational rather than an interpretive task.  I do consider this prompt, however, when I design the presentational task for the unit.

 

Although it is writing the interpretive task is the most time-consuming part of designing an IPA, I’m only a little bit embarrassed to say that I think it’s kind of fun.  I like the creativity involved in writing the tasks and always look forward to seeing what the students are able to achieve.

 

  1. Choose an authentic recorded text. In my initial research on IPA’s, I was surprised to find out that most authors advocated using either a reading OR a listening interpretive task rather than both. Even the ACTFL IPA manual has very little to say about listening comprehension. In my opinion, we do a great disservice to our students if we do not adequately address the importance of interpreting oral texts.  As a matter of fact, I believe that of all communicative tasks, this is the one for which the students need us the most.  They may be able to use Google Translate to interpret written texts or provide comprehensible written messages, but they will not be able to understand what they hear without being exposed to a wealth of authentic recorded texts in an instructional setting.  For these reasons, I nearly always include both an interpretive reading and an interpretive listening task on my IPA’s.  When selecting an appropriate “text”, I rely almost entirely on YouTube videos. Because Novice learners need a lot of visual support, I often use cartoons with them.  Trotro l’Ane, Petit Ours Brun, Caillou and Peppa Pig are a few cartoon characters whose videos I’ve used successfully with Novice learners.  More proficient students are able to interpret amateur videos made by French teenagers on a variety of topics or on authentic instructional videos.  My French 4/5 students can generally interpret news videos related to the topic of study.

 

  1. Write the interpretive listening task. Unfortunately, the ACTFL IPA manual provides very little direction when it comes to interpreting an oral text. While teachers are encouraged to use the same interpretive template to assess both reading and listening, this would not work very well given the constraints of my teaching situation. Because I have only 8 computers in my classroom, students circulate between the reading and listening sections of the IPA. Therefore, I need to limit the amount of time that an individual students spends at the computer.  The nature of the tasks on the Interpretive template would require the students to listen to the videos in their entirety several times, which would be extremely time-consuming without necessarily demonstrating deeper understanding.  In addition, many of the sections on this template would not adequately address listening comprehension.  It goes without saying that any word or phrase that is written in the target language on the IPA becomes a reading rather than a listening assessment.  While I will continue to evolve in my understanding regarding listening comprehension, I am currently relying heavily on English comprehension questions for the videos I include in my IPA’s.  Although I write the questions in the order in which the students will hear them (to save time), I try to vary the types of questions in order to assess the various levels of comprehension that are included in the ACTFL interpretive template.  In addition to informational questions about what is happening in the video (supporting details), I also ask the students to provide a main idea or summary after watching the video.  When possible, I will also include a few items which require the students to infer the meaning of a new word, based on the context of the sentence (with the understanding that the inclusion of the written sentence will negate the role of listening). When appropriate, I might also include an inference or cultural context question.  Note: because some of the cartoon videos might not come from the target culture, they may not provide a cultural context.  However, I consider them to be authentic in that the French translation was produced for a target culture audience.

 

  1. Write the interpersonal task. Based on my observation, I think this may be the area in which we have the greatest opportunity for growth. I think that many of us are labeling oral performances as interpersonal when there is little or no negotiation of meaning.  It seems to me that if a student knows in advance what s/he or the other speaker will say, it is not an interpersonal task.  In addition, if a speaker is required only to give answers, rather than also questioning, the task cannot be considered interpersonal.  While Novice Low to Novice Mid learners can only communicate using memorized phrases, this does not mean that they should be expected to reproduce memorized dialogues. For these learners, I often rely on an information gap types of activities to provide contextual support while at the same time allowing for unscripted language use.  For example, students might be given a series of pictures and asked to discuss them in order to ascertain whether each one is the same or different. This type of activity allows for a continuum of proficiency (some will use single words, while others will use simple sentences) and requires each student to both ask and answer questions.  As students become more proficient, they can manage more open-ended tasks such as discussing familiar subjects such as preferences, activities, family, eating habits, etc.  While the actual task will be highly dependent on the theme of the unit, the benchmarks in the ACTFL manual provide many good examples.  Because my upper level classes are organized around a novel or film, rather than a broader theme, I often assign role plays for interpersonal speaking tasks.  Rather than asking them to replay a scene from the film/book, I create a hypothetical situation (which could have, but did not happen) and ask the students to role play the situation.  Although I might allow them advance practice in class, they will not be assigned a role or a partner until I call on them to be assessed.   Note: With more open-ended tasks, I think it’s important to give the students a minimum time limit.  While students might prepare some of their statements in advance, based on the topic, I think it’s the “stretch” that takes place when they run out of things to say that increases proficiency in this skill.

 

  1. Write the presentational task. Most of my IPA’s include a written presentational task, but not a spoken one. Because I assess their interpersonal skills, it would often be repetitive to also assess their presentational speaking, as they would use many of the same vocabulary and structures. In addition, multiple class periods are required to listen to 30 students present on a particular topic, which I have determined is not the best use of my limited instructional time.  When developing written presentational tasks, I again rely heavily on the wording used in the IPA manual.  Thus, Novice Low-Mid students write lists and Novice High – Intermediate Low students write hypothetical blog posts, e-mails, etc. in which they express their personal experiences as they relate to the theme.  Ideally, this task will be dependent on the interpretive task.  For example, when my French 1 students read an authentic post by a family looking for an au pair, they wrote a similar post for their own family.  Likewise, after my French 2 students read a magazine article about a Canadian student’s typical day, they wrote a magazine article about their own typical day.  Because many of my upper level students will be taking the AP test, I rely heavily on prompts requiring persuasive speech that is expected on this exam.  As with the role plays, I often ask them to write a letter from character in a film/novel to another, persuading him/her to perform some action. Given the nature of each of the Presentational context, in most cases I assign a rough draft of the task as a formative assessment. I then provide feedback on this draft before having them produce a final draft on the IPA.

 

Whew, I think it took longer to write about it than it does to actually write an IPA!  If you’d like an additional example (or if you’re using the French 2 unit I described in my previous post), here’s the IPA developed for my current French 2 unit.School Unit IPA

As usual, I’d love to hear how IPA’s are working for you as well as any suggestions that you have!

Vacation all I ever wanted: a unit for Intermediate Mid students.

vacation
Since my French 3 students are coming to the end of their unit on Education in France, I’ve been working on their next unit—The French and Vacations. Although I was generally pleased with Unit 1, I’m making a few changes in the way that I structure the lessons based on what I learned from my first units.
Unit Design
This vacation unit is designed to address the following Intermediate Mid Can-Do Statements:
Interpretive Reading: I can understand basic information in ads, announcements, and other simple tasks.
• Students will read two infographics, an article about the history of vacations in France, and a web page about vacations in the world.
Interpersonal Communication: 1) I can start, maintain and end a conversation on a variety of familiar topics. Subtopic: I can ask for information, details and explanations during a conversation. 2) I can talk about my daily activities and personal preferences. Subtopic: I can give some information about activities that I did.
• Students will discuss pros/cons of vacation destinations/lodging, a vacation they have taken, their opinions about vacations and a vacation they would like to take.
Presentational Writing: 1) I can write messages and announcements.2) I can write short reports about something I have learned or researched.
• Students will write messages about real, imaginary, and ideal vacations and a report about the history of vacation in France.
Presentational Speaking: 1) I can make a presentation about my personal and social experiences. Subtopic: I can describe a childhood or past experience. 2) I can make a presentation on something I have learned or researched.
• Students will present photos of their actual (or imaginary) vacations, leave a message about an imaginary awful vacation, prepare a presentation about the history of vacation in France, and prepare a presentation about their ideal vacation.
Interpretive Listening: I can understand the main idea of what I listen to for personal enjoyment. Subtopic: I can understand a short YouTube clip.
• Students will watch several cartoon videos in which the characters go on various types of vacations. (These activities are found in a separate document. One will be chosen for each of the lessons and will be included in the lesson handout.)
Unit Plan
I anticipate that each of the four lessons in this unit will take 2-3 days. On the first day the students will complete the interpretive reading task. As they are reading, they will be taking turns using the 8 computers in my room to complete the listening activities. In Unit 1 I played the videos to the class as a whole, but found that this made my lessons too teacher-directed. Students were intimidated by answering my questions in front of their peers and/or struggled to understand what I was asking. I am hoping that by having the students work individually on these tasks they will have the opportunity to listen to the videos repeatedly, and improve their comprehension. In addition, I will be able to use these tasks as formative assessments and will be able to give individualized feedback on their performance. Students will spend any remaining class time working on the written presentational task, which will be finished for homework.
Students will begin the second day of each lesson by completing the interpersonal task. I will circulate among the students as they engage in the discussion, choosing some pairs to assess formatively. I will also call upon students to present the results of their discussions to the class. These students will also be assessed formatively, so that I will have provided specific feedback/a formative assessment for each student by the end of the unit. Students will spend the remaining part of the period preparing for the presentational speaking, and will continue this preparation for homework. On the third day I will randomly choose a few students to present what they have prepared to the class for a formative assessment. The rest of the students will present to a partner who will evaluate them using a peer assessment rubric.
After all of the lessons are completed, the students will complete their summative assessment, an Integrated Performance Assessment. This assessment will similar to each of the lessons, in that it will assess Interpretive Reading (an article about vacations) Interpretive Listening (another cartoon video), Interpersonal Communication (a vacation discussion), Presentational Speaking and a Presentational Writing. I am considering giving the students the opportunity to choose one of the Presentational Writing and Speaking Tasks from the unit and having them revise their original draft/practice their speaking and then using the same prompt for the Summative Assessment/IPA. In this way there would be an element of student choice in the assessment process.
Here is a copy of the documents that I prepared for this unit: vacation unit
Vacation Listening Activities
If you have any feedback for me on this unit, please post a comment above!