Metraipolis › archive › dc_fe36d346b3f3

Large language models show systematic failures in incorporating evolving medical knowledge — arXiv:2610.30631

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.30631
License (as archived)
CC0-1.0
Archived
2026-10-25T20:52:57.321Z
SHA-256 of the archived text
d6c38aae85b5cc5e2b9a69b6da198438b34f3d8f26cf7076e54a470d31accddd
Stable URL of this page
https://metraipolis.com/documento/dc_fe36d346b3f3

How to cite

Large language models show systematic failures in incorporating evolving medical knowledge — arXiv:2610.30631 — arXiv (en), https://arxiv.org/abs/2610.30631 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fe36d346b3f3 (Metraipolis archive dc_fe36d346b3f3, sha256 d6c38aae85b5cc5e2b9a69b6da198438b34f3d8f26cf7076e54a470d31accddd)
BibTeX
@misc{dcfe36d346b3f3,
  title = {Large language models show systematic failures in incorporating evolving medical knowledge — arXiv:2610.30631},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.30631},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fe36d346b3f3; sha256 d6c38aae85b5cc5e2b9a69b6da198438b34f3d8f26cf7076e54a470d31accddd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.30631. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Medical knowledge evolves as clinical guidelines revise recommendations, yet whether large language models (LLMs) faithfully incorporate such changes remains unclear. We introduce ChronoEvo, comprising 1,709 recommendation-level revisions across 12 forms of medical knowledge change, to distinguish recognition of revised guidance from incorporation into clinical recommendations. In the primary model, 90.8% of responses recognized revisions and 80.2% were clinically correct, but only 58.5% fully incorporated guidance, yielding a 32.3-percentage-point recognition-incorporation gap. This dissociation persisted across 14 models and was corroborated by two clinicians' adjudicated assessment of 300 responses, yielding a 40.3-percentage-point gap in the validation sample. Changes in recommendation strength and patient eligibility were associated with retention of outdated guidance. A revision-salience intervention reduced outdated-content retention and improved clinical correctness but did not significantly improve full incorporation. These findings identify faithful incorporation of evolving medical knowledge as a distinct challenge for clinical LLM reliability, even when updated guideline evidence is available.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.30631 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-25T20:47:56.844Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).