7 Steps to Creating an Integrated Performance Assessment (IPA)

yayAlthough I am embarrassed to admit it, I had never heard of an IPA (or IP-Yay, as one of my classes calls them) until May, 2013 when I attended a presentation by my state’s foreign language association.  Because our state was including a student progress measure on our teacher evaluation system for the first time, our association took an active role in encouraging us to use a measurement of student proficiency, rather than as assessment of vocabulary/grammatical accuracy to document our students’ learning.  Although I had been somewhat familiar with various proficiency descriptors, I had never designed my instruction to increase and assess student proficiency until attending this important session.  However, as the result of this presentation and two others that I subsequently attended, I made dramatic changes to my instructional and assessment strategies in order to encourage student proficiency, rather than simply grammar and vocabulary accuracy.  While I read what I found online about IPA’s, I did not have a good overall understanding of the specifics of this type of assessment until I finally stumbled across the manual found here: http://www.actfl.org/publications/guidelines-and-manuals/implementing-integrated-performance-assessment .  While I make some modifications based on my own teaching situation and students’ needs, I have relied heavily on this manual when developing my own assessments.  However, I am no expert in this process and have not received any specific ACTFL training.  The ideas expressed here reflect only my current understanding of proficiency-based assessment.  What I can say for sure is that the transition from traditional tests to IPA’s, has improved student learning in my classes more than any other change I’ve made during my 25 year teaching career.

Based on my own experience, here are the steps that I suggest when designing an IPA:

  1. Decide what you want to assess. Based on the principle of backwards design, writing the summative assessment is one of the very first steps in developing a unit plan. Therefore, I write my IPA before developing any of my lesson plans for the unit. I recently heard a speaker say, “You teach what you test.”  While this seemed counter-intuitive to me at first, as I thought about it more it made perfect sense.  When we choose how to assess our students, we are demonstrating what we wanted them to learn. If it’s not on the “test,” we probably didn’t think it was that important.  In a proficiency-based classroom, that means that we assess our students’ ability to communicate across the modes of communication.  So, the first step in designing an IPA is to choose a benchmark for each mode based on the ACTFL Can-Do Statements (http://www.actfl.org/global_statements ). Note: The bold print statement is the benchmark, and the statements which follow (preceded by a box) are examples.  Sometimes I choose one of the examples, but other times I create my own based on the theme I have chosen for my unit.

 

  1. Choose an authentic written text. Based on the interpretive reading benchmark I have chosen, I find an authentic, culturally-rich text that will enable the students to demonstrate that they have achieved the benchmark. The type of text that will be appropriate depends on the proficiency-level of the students. Novice learners are highly dependent on using visuals when interpreting so I use infographics, picture books, brochures, catalogues, or comic strips for these students.  Note: Try using Google Images, rather than just Google when searching for texts for these students. Here are some other resources I use for Novice learners:

http://www.iletaitunehistoire.com/genres/documentaires

https://www.envolee.com/fr/catalogue/1/8-du-plaisir-a-lire (Although there is a fee for downloading these texts, I have found this to be money well spent.)

http://www.scholastic.ca/education/envol_en_litteratie/downloadablebooks.html (Also worth the fee)

 

While Intermediate Low to Mid learners are able to interpret lengthier texts, they are often unable to understand authentic texts written for their developmental age (in language programs that begin in high school).   These students usually enjoy tapping into their “inner child” by reading magazine articles and online material written for younger students. I find it helpful to use a children’s search engine when researching materials for these students.  Here are a few that I’ve used:

 

http://www.takatrouver.net/takamag/index.php

http://www.coolgo.fr/

http://www.kidadoweb.com/

http://www.lespagesjuniors.com/

http://www.webjunior.net/

 

When possible, I use articles from authentic children’s magazines for interpretive tasks. These materials are often more visually rich than online materials. I have found several relevant articles for French 2 students in Astrapi, while I prefer Okapi for my French 3 students. My level 4/5 students are able to interpret the texts written for teenagers in Phosphore.

 

  1. Write the interpretive reading task. Once I have chosen the authentic text, I write the actual assessment based on the template found here: http://www.actfl.org/publications/guidelines-and-manuals/implementing-integrated-performance-assessment . While I think the template is self-explanatory, I thought I’d share a few tips for each section.

#1: I write the Key Word Recognition section by typing about the English translation of about 10 words/phrases from the text that I think the students will already know, based on prior instruction or the activities in the unit being assessed. Note: Sometimes I “cheat” here to introduce a new vocabulary word that the students will need in order to interpret the text.  I do so by writing the entire phrase in which the word appears.  When searching for the phrase in the text, they will be able to use the context to determine the meaning of the targeted vocabulary item.

#2: Main Idea.  Most of my students don’t write the main idea until they have completed the Supporting Details section. It would probably make sense to move this section accordingly when typing an IPA.  When assigning a literary text, I change the wording here so that the students are writing a 2-3 sentence summary, rather than a main idea.

#3: Supporting Details. This is the core section of the task, where students will really have a chance to show you what they know. Remember that these are statements, not questions.  The students are not providing answers, they’re writing details to show that they understood more than the main idea the text.  I try to give them a chance to really show off here by writing very general statements, so that they can use as many details as possible.  Although the template suggests writing 8 statements (3 of which will be distractors) I often write more based on the length of the text.  I have noticed that I often learn more about my students’ comprehension from their errors on the distractors than on the details they provide for the “correct” statements.  Because most of my texts are informational in nature, the students can use their background knowledge to provide logical answers, without actually understanding the text.  However, when they provide a detail for a distractor, I know that they are using what they know rather than what they’ve read.  Note: I generally omit the requirement that the students “write the letter of the detail next to where it appears in the text.”  I did not find that this step was difficult to assess and didn’t supply me with any additional information about what the students understood.

#4: Organizational Features.  In the interest of full disclosure, I have to admit that I sometimes omit this section.  While I recognize that identifying the organizational structure is an important top-down process, I do not feel that assessing this skill provides much additional information about the students’ comprehension of a text.  For novice learners who are interpreting infographics or other simple texts, the organization is so obvious that the students often see this step as needless busywork.

#5: Guessing Meaning from Text.  My students consistently score the lowest on this section of the interpretive task.  As suggested in the ACTFL manual, I type the entire sentence in which the word is located, as well as provide a description of where in the text the sentence is located.  The students’ often respond with an English word that is similar in spelling, but not meaning to the French word.  This indicates to me that they are not using the context clues to infer the meaning of the word.  Because of the difficulty of this task, I usually include more than three items in this section so that students have a greater opportunity for success.  In addition, I’ll continue to encourage them to rely more on context for these items.

#6: Inferences. The ACTFL template gives great examples of appropriate inference tasks.  Make sure to note that for novice learners it’s appropriate to give a choice of possible inferences and have the students choose which one is supported by the text and provide justification.  When I began using this template, I was pleasantly surprised by how much this section demonstrates the depth of the students’ comprehension.

#7: Author’s Perspective. While I think this task is very important for my upper level students, it is often not applicable for the types of texts that Novice learners read.  Although I suppose we could say that the perspective of the “author” of a menu is that the food is delicious, I don’t think requiring the students to explain this is a good use of their time or mine.

#8: Comparing Cultural Perspectives. I again rely heavily on the suggestions given in the ACTFL template for this task.  I have found, however, that the students need more specific directions for this section.  For example, I have had to explain that “It would be written in English.” Is not an acceptable response to the question regarding how the article would be different if it was written for an American audience.  I have also been quite liberal in the type of answer that might demonstrate a perspective, rather than just a product or practice.  While this distinction is an important one, Novice learners are sometimes not able to even identify the relationship between practices and perspectives in their own culture, let alone a culture about which they know very little.

#9: Personal Reaction. I generally omit this section from the interpretive task.  Because the instructions state that the response should be in the target language, I consider it a presentational rather than an interpretive task.  I do consider this prompt, however, when I design the presentational task for the unit.

 

Although it is writing the interpretive task is the most time-consuming part of designing an IPA, I’m only a little bit embarrassed to say that I think it’s kind of fun.  I like the creativity involved in writing the tasks and always look forward to seeing what the students are able to achieve.

 

  1. Choose an authentic recorded text. In my initial research on IPA’s, I was surprised to find out that most authors advocated using either a reading OR a listening interpretive task rather than both. Even the ACTFL IPA manual has very little to say about listening comprehension. In my opinion, we do a great disservice to our students if we do not adequately address the importance of interpreting oral texts.  As a matter of fact, I believe that of all communicative tasks, this is the one for which the students need us the most.  They may be able to use Google Translate to interpret written texts or provide comprehensible written messages, but they will not be able to understand what they hear without being exposed to a wealth of authentic recorded texts in an instructional setting.  For these reasons, I nearly always include both an interpretive reading and an interpretive listening task on my IPA’s.  When selecting an appropriate “text”, I rely almost entirely on YouTube videos. Because Novice learners need a lot of visual support, I often use cartoons with them.  Trotro l’Ane, Petit Ours Brun, Caillou and Peppa Pig are a few cartoon characters whose videos I’ve used successfully with Novice learners.  More proficient students are able to interpret amateur videos made by French teenagers on a variety of topics or on authentic instructional videos.  My French 4/5 students can generally interpret news videos related to the topic of study.

 

  1. Write the interpretive listening task. Unfortunately, the ACTFL IPA manual provides very little direction when it comes to interpreting an oral text. While teachers are encouraged to use the same interpretive template to assess both reading and listening, this would not work very well given the constraints of my teaching situation. Because I have only 8 computers in my classroom, students circulate between the reading and listening sections of the IPA. Therefore, I need to limit the amount of time that an individual students spends at the computer.  The nature of the tasks on the Interpretive template would require the students to listen to the videos in their entirety several times, which would be extremely time-consuming without necessarily demonstrating deeper understanding.  In addition, many of the sections on this template would not adequately address listening comprehension.  It goes without saying that any word or phrase that is written in the target language on the IPA becomes a reading rather than a listening assessment.  While I will continue to evolve in my understanding regarding listening comprehension, I am currently relying heavily on English comprehension questions for the videos I include in my IPA’s.  Although I write the questions in the order in which the students will hear them (to save time), I try to vary the types of questions in order to assess the various levels of comprehension that are included in the ACTFL interpretive template.  In addition to informational questions about what is happening in the video (supporting details), I also ask the students to provide a main idea or summary after watching the video.  When possible, I will also include a few items which require the students to infer the meaning of a new word, based on the context of the sentence (with the understanding that the inclusion of the written sentence will negate the role of listening). When appropriate, I might also include an inference or cultural context question.  Note: because some of the cartoon videos might not come from the target culture, they may not provide a cultural context.  However, I consider them to be authentic in that the French translation was produced for a target culture audience.

 

  1. Write the interpersonal task. Based on my observation, I think this may be the area in which we have the greatest opportunity for growth. I think that many of us are labeling oral performances as interpersonal when there is little or no negotiation of meaning.  It seems to me that if a student knows in advance what s/he or the other speaker will say, it is not an interpersonal task.  In addition, if a speaker is required only to give answers, rather than also questioning, the task cannot be considered interpersonal.  While Novice Low to Novice Mid learners can only communicate using memorized phrases, this does not mean that they should be expected to reproduce memorized dialogues. For these learners, I often rely on an information gap types of activities to provide contextual support while at the same time allowing for unscripted language use.  For example, students might be given a series of pictures and asked to discuss them in order to ascertain whether each one is the same or different. This type of activity allows for a continuum of proficiency (some will use single words, while others will use simple sentences) and requires each student to both ask and answer questions.  As students become more proficient, they can manage more open-ended tasks such as discussing familiar subjects such as preferences, activities, family, eating habits, etc.  While the actual task will be highly dependent on the theme of the unit, the benchmarks in the ACTFL manual provide many good examples.  Because my upper level classes are organized around a novel or film, rather than a broader theme, I often assign role plays for interpersonal speaking tasks.  Rather than asking them to replay a scene from the film/book, I create a hypothetical situation (which could have, but did not happen) and ask the students to role play the situation.  Although I might allow them advance practice in class, they will not be assigned a role or a partner until I call on them to be assessed.   Note: With more open-ended tasks, I think it’s important to give the students a minimum time limit.  While students might prepare some of their statements in advance, based on the topic, I think it’s the “stretch” that takes place when they run out of things to say that increases proficiency in this skill.

 

  1. Write the presentational task. Most of my IPA’s include a written presentational task, but not a spoken one. Because I assess their interpersonal skills, it would often be repetitive to also assess their presentational speaking, as they would use many of the same vocabulary and structures. In addition, multiple class periods are required to listen to 30 students present on a particular topic, which I have determined is not the best use of my limited instructional time.  When developing written presentational tasks, I again rely heavily on the wording used in the IPA manual.  Thus, Novice Low-Mid students write lists and Novice High – Intermediate Low students write hypothetical blog posts, e-mails, etc. in which they express their personal experiences as they relate to the theme.  Ideally, this task will be dependent on the interpretive task.  For example, when my French 1 students read an authentic post by a family looking for an au pair, they wrote a similar post for their own family.  Likewise, after my French 2 students read a magazine article about a Canadian student’s typical day, they wrote a magazine article about their own typical day.  Because many of my upper level students will be taking the AP test, I rely heavily on prompts requiring persuasive speech that is expected on this exam.  As with the role plays, I often ask them to write a letter from character in a film/novel to another, persuading him/her to perform some action. Given the nature of each of the Presentational context, in most cases I assign a rough draft of the task as a formative assessment. I then provide feedback on this draft before having them produce a final draft on the IPA.

 

Whew, I think it took longer to write about it than it does to actually write an IPA!  If you’d like an additional example (or if you’re using the French 2 unit I described in my previous post), here’s the IPA developed for my current French 2 unit.School Unit IPA

As usual, I’d love to hear how IPA’s are working for you as well as any suggestions that you have!

24 thoughts on “7 Steps to Creating an Integrated Performance Assessment (IPA)

  1. MaryAnn

    I was looking for ideas on shopping in France, but can’t find articles on specialty shops. Any ideas on what words to use in the search? sites?

    Thanks for sharing.
    Maryann

    Reply
  2. Pingback: Brillante Viernes: January 16, 2015 | Maris Hawkins

  3. Natalia

    Thank you for this detailed explanation. I am starting to do more of IPA style assessments this year as well and it is really helpful. Can’t wait for my IPA workshop in March at Central States for the official training on the matter!

    Could you, please, check the link to sample IPA you provided at the end of the post for your French 2 school unit? I am hoping to use many of your ideas and #authres from the previous post and would love to see how you plan to assess this unit on a Novice Level.

    Merci!

    Reply
    1. madameshepard Post author

      Natalia, Thank you soooo much for letting me know about the mistake on the link to the IPA. I’m so embarrassed about the mistake, and can’t believe no one has mentioned it yet! I have corrected the error, and the actual IPA is now included. My students are currently taking the IPA and are finding it pretty challenging. I might revise the reading in the future. My strongest students are doing well, but the others are struggling with the supporting details. Surprisingly (to me) , they have been successful with the main idea, author’s perspective, and inference questions, in spite of lacking the necessary vocabulary to understand many of the details. Let me know how it goes, if you decide to use any of it! Lisa

      Reply
  4. Ariadne Livaditis

    MERCI MILLE FOIS! Thank you! You are an inspiration as a teacher. As a new teacher, I love incorporating authentic resources and your approach has allowed me to create my own themes. Thank you again!

    Reply
    1. madameshepard Post author

      Awww. Thank you so much for leaving such a nice comment. Welcome to the world’s greatest profession and Bonne Chance!

      Reply
  5. Lauren

    I am a Spanish teacher and this is my second year using IPAs as our chapter tests in my classes. Many of your thoughts on the process are very similar to mine. The way you have implemented the different tasks, especially the interpretive task, is very similar to what I am doing. I have also tweaked the ACTFL format in the same ways. I feel better about having made changes to some sections knowing that you found the same changes necessary as well!

    Reply
  6. Shari

    Thank you SOOOOO much for this AMAZING blog!!! I am thinking about making the jump to a proficiency-based approach to teaching Intro to French (6th grade, 9-week class), French 1A (7th), French 1B (8th) and French 3 but am wondering if I should just try it in small bits the first year or jump in hook, line and sinker. My husband thinks I’m biting off more than I can chew to actually contemplating going to this format completely. Would I actually have the time (I also have 3 kids!) to go for it all at once? Any advice on this front? I’ve been teaching for 11 years (taught for 9 years, took 9 years off to raise my kids and have been back in the classroom for 2 years). This just seems SO compelling!!!!!!!!!!!

    Reply
    1. madameshepard Post author

      I don’t think there’s anything wrong with starting slowly. I’m not sure what your current teaching style is, but you could maybe start supplementing with more authentic materials and maybe start incorporating IPA’s. You could still keep your textbook around for times when you aren’t able to design a complete unit around authentic materials. That said, I went “cold turkey” last year with 4 full year preps. I’m just not a half-way kind of person. However, my children are grown and my husband is a saint who was willing to do nearly all the shopping, cooking, laundry and cleaning so that I could work 70+ hours a week. I’m not sorry that I did it that way, though, I had a great year and loved creating the lessons. I told myself that if I just put enough time in last year, this year would be a breeze. Unfortunately(?), I’m already changing everything from last year because I think I can make it better. Whatever you decide, Bonne Chance and let me know what I can do to help! Lisa

      Reply
  7. Shari

    You sound like someone who thinks/approaches teaching in much the same way I do!!! If I think I have found a better way of doing things, to potentially solve what I wasn’t as happy with last year, I just want to start right away but I am very worried about the amount of time it would take me. I’m constantly tweaking and rethinking everything I do. I look forward to delving into your blog more and will be in touch with further questions as I proceed.

    Reply
  8. Cybil

    Hello! I stumbled across your blog, and I am so thankful that I did! This post in particular has helped me tremendously as I prepare to create my first IPA! I do have a couple questions that I hope you can answer. First, as you are writing your IPA, do you always have students do something similar to what they read when they complete the interpersonal and presentational tasks? If so, do they also use the information from the listening as well as the writing when they complete the tasks? Lastly, when you have your novice students read an infographic, can you give an example of something that they might write for the presentational writing? I appreciate any suggestions you can give! I have just ordered my own copy of the Integrating IPA book. I cannot believe I didn’t know about this! I actually studied under Dr. Eileen Glisan at IUP and see her every year at their methodology conference! 🙂

    Thank you!
    Cybil

    Reply
    1. madameshepard Post author

      Hi, Cybil I’m glad you found me, too! I try to follow the IPA manual by basing the interpersonal and presentational tasks on the interpersonal one. I am still working on creating overarching contexts to tie all of the tasks together, and I do better on some IPA’s than on others. The addition of a listening on each IPA makes this integration even more difficult. ACTFL suggests one interpretive task, and I think the majority of teachers use a reading. They are easier to find, more comprehensible to students and easier to integrate with the other tasks. However, I personally feel that it is important to assess listening with the same frequency as reading, so I include a listening task on each IPA. As I gain more experience, I am getting better at integrating the listening into the rest of the IPA, but sometimes it’s a stretch, and any earlier IPA’s that you find here will not be as integrated as I would like. I have viewed by blog as a way to reflect on and share my journey, not as a vehicle for showcasing perfection (as you have undoubtedly noticed!). As for the infographic question, since early novices can really only present information about themselves, I would have them write something about themselves, based on information from the infographic. For example, if they read an infographic about French leisure activities, they might write about which activities they like/don’t like to do. This, of course, brings up the issue of whether or not the students should have access to the infographic when doing the writing. I don’t personally feel that I am able to acccurately assess their skills if they are simply copying words from a document, so I would probably disallow use of the text during the writing task. At upper levels, when the students are writing more creative responses, I allow them to have the text, but design a task that could not be completed by using specific phrases/sentences from the text. Thank you so much for asking such great questions and I’ll look forward to continuing this dialogue if you have additional ones! Lisa

      Reply
  9. Shelley

    I find that even though I have been changing my teaching style over the last few years, this move towards proficiency and using the ideas behind comprehensible input have been the most invigorating. I’ve been learning tons from your IPA examples and this thorough “how to” is just what I’ve needed. We haven’t heard too much about profieciency in Canada (at least not as official as it seems to be in the U.S., so I’ll be interested to see if it becomes a big a part of our ground work. Thanks for all this info!

    Reply
    1. madameshepard Post author

      Thanks so much for taking the time to leave such a nice comment. I’ll be curious to hear whether the focus on proficiency becomes part of the Canadian standards. Although proficiency has been part of our standards for many years, I think the vast majority of our teachers are still designing instruction based on explicit grammar points and vocabulary lists. It’s so difficult to teach in a way that’s different from how one learned, and so time-consuming to create lessons based on authentic resources. Fortunately, technology makes it so easy for teachers to collaborate, so that each of us doesn’t have to start from scratch. Let me know if there’s anything I can do to help you along your own journey. Lisa

      Reply
  10. Becky Lapic

    Bonjour Madame Shepard,
    I have been following you through the facebook page and on your blog for a while now. I actually think I was one of the first members of the facebook page. I appreciate your resources so much. A few years back, on my own, without researching or getting input from others, I decided to start including authentic resources.(specifically listening comprehension pieces) I spent hours upon hours trying to find level appropriate resources and creating materials to accompany them. With your units of study available, I have been able to get a much better feeling for the organization and types of videos to present. I will hopefully be re-writing the French curriculum , starting with level I, this summer. The above article and the 4 steps to creating a proficiency map will be very useful. As with many others, I am the only French teacher in my school. I am sure you have been told, but you should know a million times over, that you have had a profound impact on how many students are now acquiring language. You help give us, the teachers, the push we need to keep striving for student achievement. Merci infiniment!

    Reply
  11. Steve

    Madame Shepard, I’m so happy that you have made this blog. Your explanations are very helpful. My trouble is finding effective resources (particularly audio) to fit within the 6 themes. I find that I spend hours upon hours looking for something on-topic, usually with no results. Do you have a good site (or sites) where these can be found by typing in the topic/category?

    Thank you for any assistance you can provide.

    Reply
  12. Sarah G

    What do your rubrics look like for all of these tasks? I have seen multiple examples, but it would be wonderful if ACTFL would come out with a set of rubrics for each mode that we could use consistently across our levels!

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *