Metraipolis › archive › dc_f7365409fd85
Confirming Our Biases? Evaluating the Capabilities, Risks, and Societal Impact of Large Language Models — arXiv:2608.06977
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.06977
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T09:46:57.233Z
- SHA-256 of the archived text
6b87067d30a3551b6d89cdbe08c22a0043078ac20b74ab6b20c2a06e0702ffbb- Stable URL of this page
https://metraipolis.com/documento/dc_f7365409fd85
How to cite
Confirming Our Biases? Evaluating the Capabilities, Risks, and Societal Impact of Large Language Models — arXiv:2608.06977 — arXiv (en), https://arxiv.org/abs/2608.06977 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f7365409fd85 (Metraipolis archive dc_f7365409fd85, sha256 6b87067d30a3551b6d89cdbe08c22a0043078ac20b74ab6b20c2a06e0702ffbb)
BibTeX
@misc{dcf7365409fd85,
title = {Confirming Our Biases? Evaluating the Capabilities, Risks, and Societal Impact of Large Language Models — arXiv:2608.06977},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.06977},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f7365409fd85; sha256 6b87067d30a3551b6d89cdbe08c22a0043078ac20b74ab6b20c2a06e0702ffbb},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.06977. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
It is well established that large language models (LLMs) are sensitive to prompt framing, reflecting patterns in their training data or prior prompts. In this study, we investigate the extent to which LLMs reinforce users biases expressed in the prompts and examine the boundary between implicit framing effects and explicit prompt manipulation. Specifically, we evaluate how susceptible LLMs are to direct and suggestive prompts that encourage models to support or challenge particular positions. We evaluate six LLMs using 160 distinct prompts spanning ten topics across opinion-based and factual domains. The prompts systematically vary in prompting strategy, support versus challenge instructions, prompt polarity, users' expressed beliefs, and topic domain, spanning both opinion-based and factual questions. Our results show that LLMs systematically adapt their responses to align with prompt framing, even in factual contexts. This suggests that prompt framing can outweigh factual consistency in model responses. Overall, our findings delineate the extent and boundaries of LLM manipulability. Furthermore, the results imply that LLMs can reinforce subtle user biases and are susceptible to explicit prompt manipulation even in domains where responses should remain factually stable. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-10 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2608.06977 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T09:46:37.232Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).