Metraipolis › archive › dc_ae1bc6c3ed85

Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments — arXiv:2611.00597

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.00597
License (as archived)
CC0-1.0
Archived
2026-11-03T10:34:19.017Z
SHA-256 of the archived text
2e558f3215d112c7b7c599d1aca832e5c4b1e6b1eabd5ac5fea40da30385c871
Stable URL of this page
https://metraipolis.com/documento/dc_ae1bc6c3ed85

How to cite

Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments — arXiv:2611.00597 — arXiv (en), https://arxiv.org/abs/2611.00597 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ae1bc6c3ed85 (Metraipolis archive dc_ae1bc6c3ed85, sha256 2e558f3215d112c7b7c599d1aca832e5c4b1e6b1eabd5ac5fea40da30385c871)
BibTeX
@misc{dcae1bc6c3ed85,
  title = {Multi-Estimate Elicitation Does Not Uniformly Debias Language Model Judgments — arXiv:2611.00597},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00597},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ae1bc6c3ed85; sha256 2e558f3215d112c7b7c599d1aca832e5c4b1e6b1eabd5ac5fea40da30385c871},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00597. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Does eliciting five weighted estimates within a single response change how a language model responds to information? Across anchoring, hindsight, base-rate, conjunction, and status-quo/default tasks, we compare direct numerical answers with a multi-estimate response format, contrasting source framings, explicitly random cues, and probability-consistency constraints. We evaluate three completed configurations--gpt-6.1-sol, claude-sonnet-5.5, and Qwen3-8B (reasoning disabled, analyzed descriptively). In the first two configurations, direct elicitation yielded near-zero irrelevant-anchor indices and status-quo effects, while remaining responsive to informative sources and informed advice. Of 23 preregistered confirmatory tests, six rejected after Holm adjustment; however, all six absolute point estimates fell below their prespecified smallest effect sizes of interest without establishing equivalence. Moreover, while separate versus joint elicitation shifted conjunction judgments, interpretation is constrained by between-call noise. Ultimately, multi-estimate elicitation failed to produce uniform debiasing or response attenuation across tasks and models, though post hoc correlations between candidate spread and anchoring error motivate independent predictive validation. Materials: this https URL

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.00597 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:29:48.708Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).