My 8th Graders and The Pineapple Questions

After Day 1 of testing, I asked my students, "How did it go? What did you think?"  They had just taken the multiple choice portion of the NY State ELA Exam that included The Pineapple and the Hare story, and the ridiculous questions that followed it. 

"That pineapple story was so weird! And the questions were even weirder!" students called out, eager to debrief.

"I said the moose!" 

"Oh, I said the hare!" 

"No it was the owl, because he said the pineapple had no sleeves!" 

"Yeah, it's the owl, because he figured out the moral!"

"But the moral is that pineapples don't have sleeves. That's not wise; that's a joke!"

"It was the hare, because he was the only one who was right about the pineapple."

We had a similar debate about how the animals were feeling when they ate the pineapple.

"There was really no evidence about how they felt. You basically had to guess!" one student said. 

Then another student offered wisely, "See, you can't ask this type of question on a test like this, because it's an opinion question.  You have to explain your answer for it to make sense.  Which animal is the wisest?  That depends on your opinion and your reasons.  You can't make it multiple choice."

"I'm really glad you just said that," I said.  "I've been teaching you for the last two years that in literature there are multiple interpretations, and that in the study of literature we work on making compelling arguments for our interpretations with evidence and analysis.  Questions like this really contradict what we're about. I'm sorry you had to go through the pressure of trying to answer lousy questions 'correctly.' And for the record, I could not figure out the 'correct' answer on several questions throughout today's test. Hopefully they will be discarded."

We were told that this year there would be a handful of "trial" questions on the test that would not count toward students' scores, but that were being tested out for validity and reliability to be used in subsequent years.  For the first time, I found myself unable to identify the single correct answer on a handful of multiple choice questions.  I reassured myself that these unnecessarily tricky questions were probably the trial questions.  

On second thought, even if they don't count, how is it okay for students to encounter unfair questions in such a high pressure situation?  First, the experience could easily shake a child's confidence, which is a huge factor in success on a test. Second, perception of unfairness is the greatest detractor of motivation, according to Daniel Pink's book about motivation, Drive.  

So--on top of all of the reasons that standardized tests don't provide accurate or reliable measures of student learning or teacher effectiveness--now NY State is allowing the big, expensive tests to be experimental?  No, that's not wise--it's a joke. 

 

 

Comments

[Mark]

Great points about motivation and disruption of confidence. I noticed the same sort of questions on my 5th graders' exam. It made me realize that the very idea of testing a child's ability to analyze literature on a deeper level via a multiple choice question is a preposterous undertaking.

http://schoolecosystem.blogspot.com/2012/04/pineapple-express-tests-shortchanging.html

[Teacher]

What really bothers me is that the test maker - a for profit entity - is using our students to do research and development (free of charge). I think there is something fundamentally wrong with this. What about you?

[John Norton]

Ariel - thanks so much for providing real student feedback about this crazy luau of a story! Your 8th graders were very perceptive. I suppose they've learned one important lesson (or maybe just reinforced it): the folks over at the big ed bureaucracy aren't looking out for you, kid.

[Susan]

I'm curious - was this your state's yearly standardized test? If so, the blog and comments are very interesting. In my state, SC, teachers are not allowed to read the test items or questions, and we are not allowed to discuss the test with students afterwards. To do so would be considered a breach of test security and could cost us our jobs and teaching certificates. This is just one example of the inequities in the testing procedures across the country. I wonder if common core will change anything in this regard.....