A survey on the habit to change the answers in multiple choice questions (MCQ) exams: Does the examinee benefit?
Keywords:
Multiple choice question exams, changing answer, habitAbstract
Background Nowadays multiple choice questions (MCQs) are amongst the most accredited type of examination tools. Examinees (students) change their selected answers with the hope to get higher scores, whereas it may decrease their final scores on the contrary. This study evaluates such a habit in medical students. Materials and methods The medical students' exam papers in dermatology ward during the past nine years were reviewed to check their answer sheets for changing the answers to MCQs. Frequency of changes in changing answers to MCQs, and total effect of these changes in the final scores were evaluated and analyzed. Results In this study, 614 medical students were considered. At the end of their course in dermatology ward, 472 MCQs were used as the standard examination. Totally 45.5% of the students (41.7% males and 46.5% females) had changed their answers to the MCQs, which had no meaningful difference in terms of gender. Mean total score of both of groups, who had changed and who had not changed their answers, were compared and no changes were seen. Based on the direction of changes, this study showed that 36% of students had corrected their wrong answers, 30.2% had changed their correct answers to wrong ones and 38% had changed wrong answers to other wrong ones. Statistically no meaningful changes were seen. In 40% of students these changes had led to higher scores, 31.5% had got lower scores and 28.5 % had no change in their final scores. Conclusion Medical students who had taken part in this survey had changed their answers less than what literature explains, and fewer students had corrected their wrong answers and as a result had got lower scores. It seems that temptation to change answers based on the fine attention to MCQs and logical thought might lead to higher scores, but the change by itself had not led to better results, blind change works just by chance as in our students.References
Mathews C. Erroneous first impressions on objective tests. J Educ Psychol 1929; 20: 280-6.
Lehman HC. Does it pay to change initial decision in a true-false test? School Society 1928; 28: 450-8.
Jarrett RF. The extra-chance nature of changes in students, responses to objective test items. J Gen Psychol 1946; 38: 243-50.
Bath A. Answer-changing behavior on objective examinations. J Educ Res 1967; 61: 105-7.
Reile PJ, Briggs LJ. Should students change their initial answers on objective-type tests? More evidence regarding an old problem. J Educ Psychol 1952; 43: 110-15.
Benjamin LT, Cavell TA, Shallenberger WR. Staying with initial answers on objective tests – is it a myth? Teaching Psychology 1984; 11: 133-41.
Fischer MR, Herrmann S, Kopp V. Answering multiple-choice questions in high-stakes medical examinations. Med Educ 2005; 39: 890-4.
Bauer D, Kopp V, Fischer MR. Answer changing in multiple choice assessment change that answer when in doubt – and spread the word! BMC Med Educ 2007; 7: 28-32.
Al-Hamly M, Coombe C. An investigation into answer changing practices on multiple-choice questions with gulf Arab learners in an EFL context. University of Michigun: Spaan Fellow working papers in second or foreign language assessment; 2003; 1.
Foote R, Belinky C. It pays to switch? consequences of changing answers on multiple-choice examinations. Psychol Rep 1972; 31: 667-73.
Prinsell CP, Ramsey PH, Ramsey PP. Score gains, attitudes, and behaviour changes due to answer-changing instruction. J Educ Meas 1994; 31: 327-37.
Mueller J, Wasser V. Implications of changing answers on objective test items. J Educ Meas 1977; 14: 9-13.
Geiger MA. Changing multiple-choice answers: Do students accurately perceive their performance? J Exp Educ 1991; 59: 119-27.
Reiling E, Taylor R. A new approach to the problem of changing initial responses to multiple choice questions. J Educ Meas 1972; 9: 67-70.
Mueller DJ, Shwedel A. Some correlates of net gain resultant from answer changing on objective achievement test items. J Educ Meas 1975; 12: 251-4.
Copeland DA. Should chemistry students change answers on multiple-choice tests? J Chem Educ 1972: 49: 258.
Green K. Item response changes on multiple-choice tests as a function of test anxiety. J Exp Educ 1981; 49: 225-8.
Videler D, Hansen R. Answer changing on multiple-choice tests. J Exp Educ 1980; 49: 18-20.
Jacobs SS. Answer changing on objective tests: some implications for test validity. Educ Psychol Meas 1972; 32: 1039-44.
Pressley M, Ghatala ES. Delusions and about performances on multiple-choice comprehension test items. Read Res Q 1988; 23: 454-64.
Pressley M, Ghatala ES, Woloshyn V, Pirie J. Sometimes adults miss the main ideas and do not realize it: confidence in responses to short-answer and multiple-choice comprehension questions." Read Res Q 1990; 25: 232-49.
Zakay D, Glicksohn J. Over confidence in a multiple-choice test and its relationship to achieve-meat. Psychol Rec 1992; 42: 519-24.
Ferguson KJ, Kreiter CD, Peterson MW et al. Is that your final answer? Relationship of changed answers to overall performance on a computer-based medical school course examination. Teach Learn Med 2002, 14: 20-3.
