Option bias on multiple choice tests.

My professor told us during our review yesterday that there was a study where they found out that test makers, unconsciously, are more likely to place the correct answer to a multiple choice question either on letter B or letter C. Well I looked at my past test papers and saw that the correct answers are more frequent in B or C than in A or D. Suppose you are answering/making a multiple choice test with choices A-D:

  • Where will you likely place the correct answer?
  • On the previous tests that you made/took, which letters are more frequent?
  • If you really do not have any idea what the answer is to a question, which letter would you choose?

I’ll be taking my licensure exam in a few months and I just want an idea where to place my bets in case I chance upon a question which I really do not know the answer. Thanks everyone. :slight_smile:

I suspect that many professionally-made tests randomize the order of the choices, to prevent just such bias.

Some professors do, too. If you can program a computer at all, it’s pretty easy to write a program to do this. That’s especially helpful when you have to make several different versions of a multiple-choice exam to cut down on cheating.

Always pick C, especially on a True/False test.

I was working on a question/answer shuffler that allowed some to be “locked in,” e.g. so that “all of the above” was always D. I never got around to finishing it, though.

Licensure in what? The NCLEX (required for LPN and RN licensure) is computer randomized to control for this quirk. So it’s not a good strategy for that test.

I had a teacher once who made a test where every correct answer (50 questions) except for one was choice ‘A’. It wasn’t that hard of a test but it stressed the hell out of us taking it especially when we got to the one that didn’t fit the pattern.

Ex-college prof: Only one class, a lower than low level course, had multiple choice questions. The software to select questions, etc., had a answer shuffler so I never thought about it.

On my own tests, I liked to have the first question be a set of 5 true/false sub-questions, where each and every one sounded quite plausible. Did a little randomization of order so that it wouldn’t all be trues, then falses. But I think I usually made sure the first one was true just to get things rolling.

(Then for the next couple questions I tended to make them easier so that people might start off in a hopeful mindframe.)

I have no idea who generates large multiple choice tests by hand anymore.

Hah. How can I not think of that? Of course they would probably randomize the answers. That would be practical. The test is a licensure exam after all. Why did my teacher ever told gave us that tip? Maybe it only applies to tests made by teachers for classroom use.

Licensure in teaching. :slight_smile:

YAY! Congratulations! So, now you know something valuable for your future career: there are answer randomizers! So your students won’t be able to get away with cheap tricks like, “what in doubt, pick C!” :smiley:

I tell my students to guess the longer answer when they are stumped on the AP exam. Mostly this is just so that they have a tie-breaker criteria so that they don’t get stressed out and waste time going back and forth between two answers in a loop, but also because I do think it’s a little more likely that the more carefully qualified answer is correct. I have noticed this trend from having read pretty much every released AP English Language test from 1983 on, most of them over and over and over again.