Statistical modelling of multiple‐choice and true/false tests: ways of considering, and of reducing, the uncertainties attributable to guessing

Burton, R. F. and Miller, D. J. (1999) Statistical modelling of multiple‐choice and true/false tests: ways of considering, and of reducing, the uncertainties attributable to guessing. Assessment and Evaluation in Higher Education, 24(4), pp. 399-411. (doi: 10.1080/0260293990240404)

Full text not currently available from Enlighten.

Abstract

Test unreliability due to guessing in multiple‐choice and true/false tests is analysed from first principles, and two new measures are described, with the intention that they should be of a sort that is easily communicated without reference to the underlying statistics. One measure is concerned with the resolution of defined levels of knowledge and the other with the probability of examinees being incorrectly ranked. How the measures decrease with both test length and number of response options per question is quantified. It is concluded that the results of many tests currently conducted are likely to be unacceptably unreliable. Procedures for increasing test reliability are discussed in a logical sequence intended to aid their understanding.

Item Type:Articles
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Miller, Dr David and Burton, Dr Richard
Authors: Burton, R. F., and Miller, D. J.
College/School:College of Medical Veterinary and Life Sciences > School of Life Sciences
Journal Name:Assessment and Evaluation in Higher Education
Publisher:Taylor & Francis
ISSN:0260-2938
ISSN (Online):1469-297X

University Staff: Request a correction | Enlighten Editors: Update this record