Metraipolis › archive › dc_7f30eb5953d0
Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior — arXiv:2611.04395
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.04395
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-04T21:37:56.741Z
- SHA-256 of the archived text
f216fcd106c0f0d1082f797aeeb060920f9c107448ff378dd2fe23129c3c7aff- Stable URL of this page
https://metraipolis.com/documento/dc_7f30eb5953d0
How to cite
Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior — arXiv:2611.04395 — arXiv (en), https://arxiv.org/abs/2611.04395 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7f30eb5953d0 (Metraipolis archive dc_7f30eb5953d0, sha256 f216fcd106c0f0d1082f797aeeb060920f9c107448ff378dd2fe23129c3c7aff)
BibTeX
@misc{dc7f30eb5953d0,
title = {Correct Labels Are Not Enough: Reliable Metadata Can Silently Control Model Behavior — arXiv:2611.04395},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.04395},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7f30eb5953d0; sha256 f216fcd106c0f0d1082f797aeeb060920f9c107448ff378dd2fe23129c3c7aff},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04395. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Fine-tuning data can include metadata that predicts the correct answer, such as a reward-model score or a quality label. We ask whether a model learns to rely on this metadata even when every training label is correct. We fine-tune 7-9B open-weight models from three families on multiple-choice questions in which (Reward: 5) always marks the correct option; when this annotation is moved to a wrong option at test time, models select that option on 97-100% of CommonsenseQA items. Removing it leaves most answers correct, so evaluation without it misses the dependence. Cue-following rises sharply with training-time reliability and develops even with neutral or nonsense annotation words, although test-time wording affects its strength. A Qwen3 experiment also finds cue dependence in option-letter scores after direct preference optimization. Audits can test for this dependence by moving or removing visible annotations while holding the task and correct answer fixed. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.04395 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-04T21:35:49.543Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).