Metraipolis › archive › dc_ce51486ab9ed
Which Answer Did the Seventeen-Year-Old Write? A Behavioral Case Study of Author-Age Misattribution, Miscalibrated Confidence, and Non-Corrective Self-Explanation in… — arXiv:2610.31946
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.31946
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-26T19:52:54.835Z
- SHA-256 of the archived text
8263453a3d72b133a78cd25366da27dd57620089f28f4e0f678076cf26a10a37- Stable URL of this page
https://metraipolis.com/documento/dc_ce51486ab9ed
How to cite
Which Answer Did the Seventeen-Year-Old Write? A Behavioral Case Study of Author-Age Misattribution, Miscalibrated Confidence, and Non-Corrective Self-Explanation in… — arXiv:2610.31946 — arXiv (en), https://arxiv.org/abs/2610.31946 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ce51486ab9ed (Metraipolis archive dc_ce51486ab9ed, sha256 8263453a3d72b133a78cd25366da27dd57620089f28f4e0f678076cf26a10a37)
BibTeX
@misc{dcce51486ab9ed,
title = {Which Answer Did the Seventeen-Year-Old Write? A Behavioral Case Study of Author-Age Misattribution, Miscalibrated Confidence, and Non-Corrective Self-Explanation in… — arXiv:2610.31946},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.31946},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ce51486ab9ed; sha256 8263453a3d72b133a78cd25366da27dd57620089f28f4e0f678076cf26a10a37},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.31946. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Three students answered the same exam prompt by hand: "What is happiness? Are you happy?" Their ages, recorded at collection, are 17, 28, and 45. The 17-year-old's answer is hedged and formally phrased. Asked to match each answer to an age and gender label, most frontier language models confidently assign it to an adult. This paper reports a structured case study of that failure across six models: Claude Fable 5, Gemini 3.1 Pro, GPT-5.6 Sol, Grok 4.5, GPT-4o (2024), and DeepSeek V4. We ran 1,081 API sessions and scored 3,225 responses across six experimental conditions that manipulate framing, disclosure format, and audience-awareness instruction. Three of six models perform at or near chance (1/3) on the matching task while reporting 73-88% mean confidence. The youngest writer's answer is misattributed to an adult in up to 90% of trials. Removing the multiple-choice scaffold collapses accuracy further: three models never place within three years of the true age once open-ended estimation is required. Institutional framing ("a community-college biology final") significantly degrades the best-performing model's accuracy; a neutral label does not. A single audience-awareness instruction significantly improves one model (+21 points) and moves another to ceiling, with no detectable effect on the three weakest models. Stated confidence is uncorrelated or inversely correlated with correctness for five of six models. After ground truth is revealed, one model names its own stereotyping in 68 of 114 explanations, yet shows the lowest accuracy and highest confidence of any model under blind presentation: articulate retrospective diagnosis that does not track the quality of its judgments. This is a three-item, single-topic, single-language case study meant to isolate a mechanism, not to estimate a population bias rate. Data, code, and raw model outputs are publicly released.
Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2610.31946 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-26T19:45:48.336Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).