Metraipolis › archive › dc_eb99cc7b95c6

Patient-specific rubric-based evaluation of large language models across longitudinal cancer care — arXiv:2610.35847

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.35847
License (as archived)
CC0-1.0
Archived
2026-10-27T07:59:12.466Z
SHA-256 of the archived text
36e11dfca1da93a8109d1e3052c01fd3ba9d3af388a285522655c96d349bfc42
Stable URL of this page
https://metraipolis.com/documento/dc_eb99cc7b95c6

How to cite

Patient-specific rubric-based evaluation of large language models across longitudinal cancer care — arXiv:2610.35847 — arXiv (en), https://arxiv.org/abs/2610.35847 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_eb99cc7b95c6 (Metraipolis archive dc_eb99cc7b95c6, sha256 36e11dfca1da93a8109d1e3052c01fd3ba9d3af388a285522655c96d349bfc42)
BibTeX
@misc{dceb99cc7b95c6,
  title = {Patient-specific rubric-based evaluation of large language models across longitudinal cancer care — arXiv:2610.35847},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.35847},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_eb99cc7b95c6; sha256 36e11dfca1da93a8109d1e3052c01fd3ba9d3af388a285522655c96d349bfc42},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.35847. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) show promise in specialty medicine, yet existing evaluations largely focus on isolated clinical encounters rather than tracking how clinical responsibilities evolve across a longitudinal care pathway. Here we introduce NPC-RubricBench, a phase-aware benchmark for evaluating multistage clinical reasoning across the cancer care continuum, using nasopharyngeal carcinoma as a defined disease context. Curated from longitudinal records of 405 patients across two cancer centers, the benchmark comprises 941 patient-phase units across six sequential care phases and 17,688 patient-specific atomic criteria spanning five evaluation dimensions, with each assessment strictly restricted to decision-time clinical evidence. Evaluating 30 general-purpose and medical LLMs revealed that strong diagnostic performance does not carry over to downstream care. We evaluated 30 general-purpose and medical LLMs, showing that high diagnostic performance did not translate into improved downstream care. Instead, the dominant failure modes reversed across phases. Explicit decision errors dominated anatomical staging at 48.2%, whereas decision omissions dominated initial work-up and post-treatment follow-up at 33.4% and 30.4%, respectively. In the evaluated model set, medically adapted models showed higher omission rates than general-purpose models. Moreover, varying query granularity exposes a critical specification trade-off: broad open-ended requests degrade Decision Quality across all 30 models, while more detailed, checklist-like prompts raise Decision Quality but reduce Evidence Faithfulness and Safety Adherence. Furthermore, NPC-RubricBench demonstrates that static diagnostic benchmarks are insufficient to ensure consistent clinical reliability over time, highlighting the importance of phase-adaptive safeguards in multistage medical AI.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.35847 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-27T07:55:30.772Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).