Metraipolis › archive › dc_68114be2e710
Audit at the Precision You Deploy: Quantization Reshapes a Subliminally Learned Preference — arXiv:2611.00665
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.00665
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T11:09:46.507Z
- SHA-256 of the archived text
bb75bf94a9f37094775c6a07b68d0c0850738a9f44c9247c26c57462e0e63279- Stable URL of this page
https://metraipolis.com/documento/dc_68114be2e710
How to cite
Audit at the Precision You Deploy: Quantization Reshapes a Subliminally Learned Preference — arXiv:2611.00665 — arXiv (en), https://arxiv.org/abs/2611.00665 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_68114be2e710 (Metraipolis archive dc_68114be2e710, sha256 bb75bf94a9f37094775c6a07b68d0c0850738a9f44c9247c26c57462e0e63279)
BibTeX
@misc{dc68114be2e710,
title = {Audit at the Precision You Deploy: Quantization Reshapes a Subliminally Learned Preference — arXiv:2611.00665},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.00665},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_68114be2e710; sha256 bb75bf94a9f37094775c6a07b68d0c0850738a9f44c9247c26c57462e0e63279},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00665. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Subliminal learning allows AI models to inherit hidden preferences from seemingly unrelated training data, such as number sequences. Safety audits may evaluate models at standard 16-bit precision, while deployments may use compressed, quantized weights. We ask whether quantization changes the expression of a subliminal preference and what drives any resulting change. To investigate, we implant a "favourite animal: panda" preference into Qwen2.5-7B-Instruct. We define its net strength as the difference in mean panda-answer probability between subliminal models and neutrally trained controls under the same quantization setting. Applying this metric across different compression levels reveals a stark contrast. While behaviour remains stable at 8 bits, 4-bit quantization triggers severe, opposing shifts depending on the quantizer. Half-Quadratic Quantization (HQQ) amplifies the preference, raising the subliminally trained model's panda probability from roughly 55% at 16 bits to 64% at 4 bits, while the controls stay near 17%. This raises the trait's net strength ~1.3 times its 16-bit value. In contrast, NormalFloat (NF4) at 4-bit suppresses it, shrinking the net strength to just ~0.3 times its 16-bit value, despite producing rounding errors of the same size to within 4%. We examine the structure of the rounding errors and find that their arrangement drives the divergence. Randomly shuffling HQQ's errors within each quantization group, without changing their magnitude, shifts the trait's net strength between 0.2 and 1.6 times its 16-bit value. Despite these opposing shifts, the underlying fine-tuning signal remains largely intact. Because a model's internal state and outward behaviour diverge so unpredictably under compression, a 16-bit audit cannot reliably bound real-world risks. Safety evaluations must test the exact quantized weights intended for deployment. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2611.00665 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:59:52.268Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).