# Multiple-choice question: Wikis

Note: Many of our articles have direct quotes from sources you can cite, within the Wikipedia article! This article doesn't yet, but we're working on it! See more info or our list of citable articles.

# Encyclopedia

(Redirected to Multiple choice article)

Multiple choice is a form of assessment in which respondents are asked to select the best possible answer (or answers) out of the choices from a list. The multiple choice format is most frequently used in educational testing, in market research, and in elections-- when a person chooses between multiple candidates, parties, or policies. Multiple choice testing is particularly popular in the United States.[1]

Although E. L. Thorndike developed an early multiple choice test, Frederick J. Kelly was the first to use such items as part of a large scale assessment.[2] While Director of the Training School at Kansas State Normal School (now Emporia State College) in 1915, he developed and administered the Kansas Silent Reading Test. Soon after, Kelly became the third Dean of the College of Education at the University of Kansas. The first all multiple choice, large scale assessment was the Army Alpha, used to assess the intelligence of World War I military recruits.

The items of a multiple choice test are often colloquially referred to as "questions," but this is a misnomer because many items are not phrased as a question. For example, they can be presented as incomplete statements or mathematical equations. Thus, the more general term "item," is the most appropriate label. Items are stored in an item bank.

## Structure

Multiple choice items consist of a stem and a set of options. The stem is the beginning part of the item that presents the item as a problem to be solved, a question asked of the respondent, or an incomplete statement to be completed, as well as any other relevant information. The options are the possible answers that the examinee can choose from, with the correct answer called the key and the incorrect answers called distractors.[3] Only one answer can be keyed as correct. This contrasts with multiple response items in which more than one answer may be keyed as correct.

Usually, a correct answer earns a set number of points toward the total mark, and an incorrect answer earns nothing. However, tests may also award partial credit for unanswered questions or penalize students for incorrect answers, to discourage guessing. For example, the SAT removes a quarter point from the test taker's score for an incorrect answer.

For advanced items, such as an applied knowledge item, the stem can consist of multiple parts. The stem can include extended or ancillary material such as a vignette, a case study, a graph, a table, or a detailed description which has multiple elements to it. Anything may be included as long it is necessary to ensure the utmost validity and authenticity to the item. The stem ends with a lead-in question explaining how the respondent must answer. In a medical multiple choice items, a lead-in question may ask "What is the most likely diagnosis?" or "What pathogen is the most likely cause?" in reference to a case study that was previously presented.

## Examples

In the equation 2x + 3 = 4, solve for x.

1. 4
2. 10
3. 0.5
4. 1.5
5. 8

What is the IT superpower in India?

1. Bangalore
2. Mumbai
3. Mysore
4. Mexico

There are several advantages to multiple choice tests. If item writers are well trained and items are quality assured, it can be a very effective assessment technique.[4] If students are instructed on the way in which the item format works and myths surrounding the tests are corrected, they will perform better on the test.[5] On many assessments, reliability has been shown to improve with larger numbers of items on a test, and with good sampling and care over case specificity, overall test reliability can be further increased.[6]

Multiple choice tests often require less time to administer for a given amount of material than would tests requiring written responses. This results in a more comprehensive evaluation of the candidate's extent of knowledge. Even greater efficiency can be created by the use of online examination delivery software. This increase in efficiency can offset the advantages offered by free-response items. That is, if free-response items provide twice as much information but take four times as long to complete, multiple-choice items present a better measurement tool.

Multiple choice questions lend themselves to the development of objective assessment items, however, without author training, questions can be subjective in nature. Because this style of test does not require a teacher to interpret answers, test-takers are graded purely on their selections, creating a lower likelihood of teacher bias in the results.[7] Factors irrelevant to the assessed material (such as handwriting and clarity of presentation) do not come into play in a multiple choice assessment, and so the candidate is graded purely on their knowledge of the topic. Finally, if test-takers are aware of how to use answer sheets and/or online examination tick boxes, their responses can be relied upon with clarity.

The most serious disadvantage is the limited types of knowledge that can be assessed by multiple choice tests. Multiple choice tests are best adapted for testing well-defined or lower-order skills. Problem-solving and higher-order reasoning skills are better assessed through short-answer and essay tests. However, multiple choice tests are often chosen, not because of the type of knowledge being assessed, but because they are more affordable for testing a large number of students. This is especially true in the United States where multiple choice tests are the preferred form of high-stakes testing.[8]

Another disadvantage of multiple choice tests is possible ambiguity in the examinee's interpretation of the item. Failing to interpret information as the test maker intended can result in an "incorrect" response, even if the taker's response is potentially valid. The term "multiple guess" has been used to describe this scenario because test-takers may attempt to guess rather than determine the correct answer. A free response test allows the test taker to make an argument for their viewpoint and potentially receive credit. However, free response questions can be similarly ambiguous, and the scoring of a free response it is much more ambiguous than that of multiple choice items.

In addition, even if students have some knowledge of a question, they receive no credit for knowing that information if they select the wrong answer and the item is scored dichotomously. However, free response questions may allow an examinee to demonstrate partial understanding of the subject and receive partial credit.

Another disadvantage of multiple choice examinations is that a student who is incapable of answering a particular question can simply select a random answer and still have a chance of receiving a mark for it. It is common practice for students with no time left to give all remaining questions random answers in the hope that they will get at least some of them right. Many exams, such as the Australian Mathematics Competition, have systems in place to negate this, in this case by making it more beneficial to not give an answer than to give a wrong one. All exams scored with the three-parameter model of [item response theory] also account for guessing. This is usually not a great issue, moreover, since the odds of a student receiving significant marks by guessing are very low when four or more selections are available.

Additionally, it is important to note that questions phrased ambiguously may cause test-taker confusion. It is generally accepted that multiple choice questions allow for only one answer, where the one answer may encapsulate a collection of previous options. However, some test creators are unaware of this and might expect the student to select multiple answers without being given explicit permission, or providing the trailing encapsulation options. Of course, untrained test developers are a threat to validity regardless of the item format.

The use of multiple choice questions in certain educational fields is sometimes contested due to some of the negative aspects, whether actual or perceived, but the format remains popular due to its utility, reliability, and cost effectiveness.

The theory that a student should trust their first instinct and stay with their initial answer on a multiple choice test is a myth. Researchers have found that although people often believe that changing answers is bad, it generally results in a higher test score. The data across twenty separate studies indicate that the percentage of "right to wrong" changes is 20.2%, whereas the percentage of "wrong to right" changes is 57.8%, nearly triple.[9] Changing from "right to wrong" may be more painful and memorable (Von Restorff effect), but it is probably a good idea to change an answer after additional reflection indicates that a better choice could be made.

## References

1. ^ Phelps, Richard (Fall, 1996), "Are US Students the Most Heavily Tested on Earth?", Educational Measurement: Issues and Practice 15 (3): 19-27
2. ^ Mathews, J: "Just Whose Idea Was All This Testing?", The Washington Post, November 14, 2006.
3. ^ Kehoe, Jerard (1995). Writing multiple-choice test items Practical Assessment, Research & Evaluation, 4(9). Retrieved February 12, 2008.
4. ^ Item Writing Manual by the National Board of Medical Examiners
5. ^ Beckert, L., Wilkinson, T. J., & Sainsbury, R. (2003). A needs-based study and examination skills course improves students' performance Medical Education 37 (5), 424–428.doi:10.1046/j.1365-2923.2003.01499.x
6. ^ Steven M Downing (2004) Reliability: on the reproducibility of assessment data Medical Education 38 (9), 1006–1012. doi:10.1111/j.1365-2929.2004.01932.x
7. ^ DePalma, A: "Revisions Adopted in College Entrance Exams", The New York Times, November 1, 1990
8. ^ Phelps, Richard (Fall, 1996), "Are US Students the Most Heavily Tested on Earth?", Educational Measurement: Issues and Practice 15 (3): 19-27
9. ^ Benjamin, L. T., Cavell, T. A., & Shallenberger, W. R. (1984). Staying with the initial answers on objective tests: Is it a myth? Teaching of Psychology, 11, 133-141.