Metraipolis › archive › dc_0722c4c8a008
Determining the degree of randomness in multiple-choice question distractors — arXiv:2610.01431
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.01431
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T12:09:18.816Z
- SHA-256 of the archived text
bcd4445082cd7b04609a1dac94395160eff2d3618eb667169ac8a9903389951b- Stable URL of this page
https://metraipolis.com/documento/dc_0722c4c8a008
How to cite
Determining the degree of randomness in multiple-choice question distractors — arXiv:2610.01431 — arXiv (en), https://arxiv.org/abs/2610.01431 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0722c4c8a008 (Metraipolis archive dc_0722c4c8a008, sha256 bcd4445082cd7b04609a1dac94395160eff2d3618eb667169ac8a9903389951b)
BibTeX
@misc{dc0722c4c8a008,
title = {Determining the degree of randomness in multiple-choice question distractors — arXiv:2610.01431},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.01431},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0722c4c8a008; sha256 bcd4445082cd7b04609a1dac94395160eff2d3618eb667169ac8a9903389951b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.01431. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multiple-choice questions are a staple of educational assessment due to their efficiency, but their diagnostic ability is inherently limited. Traditional psychometric techniques infer misconceptions by fitting models to predetermined data patterns, making them ineffective for analysing small, novel, or non-standardised samples where such prior trends are absent. To address this, we introduce a new distractor analysis method based on Information Theory, which treats the randomness in incorrect answers not as noise but as a measurable signal in student answer patterns. By examining the entropy of distractor choices alongside overall accuracy, our approach offers a sample-sized-independent framework for classifying performance. Cross-referencing low-scoring item-level response data against independently documented misconceptions on a standard mechanics inventory shows that, for items identified as most concentrated (lowest degree of randomness), a majority of incorrect responses select the exact response coded to that item's named, interview-validated misconception. Furthermore, items independently flagged elsewhere as diagnostically unreliable are exactly the items the measure identifies as having the highest degree of randomness. The pedagogically actionable cases are those with low degree of randomness in a class's incorrect answers, signalling a shared, re-teachable misconception, whereas a high degree of randomness chiefly serves as the null case against which that concentration is judged. Our analysis is intended as a fast, single-administration triage step: a practical, theory-driven complement to established distractor-analysis methods that helps instructors flag which items warrant closer, more resource-intensive investigation. Tema degli esploratori: ricerca e scienza aperta (retro-catalogo arXiv: annunci del 2026-10-02 in physics.ed-ph). Categorie arXiv: Physics Education (physics.ed-ph). Pagina del lavoro: https://arxiv.org/abs/2610.01431 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T11:40:16.578Z dalla pagina https://arxiv.org/catchup/physics.ed-ph/2026-10-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).