Metraipolis › archive › dc_e7efebfee4a1
Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.16590
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T19:19:16.578Z
- SHA-256 of the archived text
07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a- Stable URL of this page
https://metraipolis.com/documento/dc_e7efebfee4a1
How to cite
Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590 — arXiv (en), https://arxiv.org/abs/2609.16590 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e7efebfee4a1 (Metraipolis archive dc_e7efebfee4a1, sha256 07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a)
BibTeX
@misc{dce7efebfee4a1,
title = {Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.16590},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e7efebfee4a1; sha256 07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.16590. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
People increasingly use frontier AI models for health advice, but via different access modes (e.g., ChatGPT, ChatGPT Health, APIs) with varying settings. Here, we find systematic differences across access modes. Because evaluations typically rely on APIs while consumers interact through chatbot interfaces, these discrepancies limit evaluation validity. Our findings underscore an urgent need for model providers to enable faithful replication of consumer experiences and settings for rigorous audits. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-16 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.16590 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T18:32:32.817Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-16?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).