Metraipolis › archive › dc_e7efebfee4a1

Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.16590
License (as archived)
CC0-1.0
Archived
2026-10-15T19:19:16.578Z
SHA-256 of the archived text
07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a
Stable URL of this page
https://metraipolis.com/documento/dc_e7efebfee4a1

How to cite

Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590 — arXiv (en), https://arxiv.org/abs/2609.16590 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e7efebfee4a1 (Metraipolis archive dc_e7efebfee4a1, sha256 07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a)
BibTeX
@misc{dce7efebfee4a1,
  title = {Challenges of Auditing: Variability in Outputs of Large Language Models for Health — arXiv:2609.16590},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.16590},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e7efebfee4a1; sha256 07d785fd442aad8b708250f92c28cfe7e32d85248f9f13563c246116a2d1660a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.16590. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

People increasingly use frontier AI models for health advice, but via different access modes (e.g., ChatGPT, ChatGPT Health, APIs) with varying settings. Here, we find systematic differences across access modes. Because evaluations typically rely on APIs while consumers interact through chatbot interfaces, these discrepancies limit evaluation validity. Our findings underscore an urgent need for model providers to enable faithful replication of consumer experiences and settings for rigorous audits.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-16 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.16590 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T18:32:32.817Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-16?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).