Metraipolis › archive › dc_f3a4733fc9cf

Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs — arXiv:2610.06685

Source
arXiv
Original
https://arxiv.org/abs/2610.06685
License (as archived)
CC0-1.0
Archived
2026-10-06T05:28:57.811Z
SHA-256 of the archived text
c6e7fb7986bb6966f58f6d9db3201508849b7b2a020597f904639ef705ee28d5
Stable URL of this page
https://metraipolis.com/documento/dc_f3a4733fc9cf

How to cite

Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs — arXiv:2610.06685 — arXiv, https://arxiv.org/abs/2610.06685 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f3a4733fc9cf (Metraipolis archive dc_f3a4733fc9cf, sha256 c6e7fb7986bb6966f58f6d9db3201508849b7b2a020597f904639ef705ee28d5)
BibTeX
@misc{dcf3a4733fc9cf,
  title = {Aligning Multimodal Patient Evidence with Biomedical Knowledge Graphs for Clinical LLMs — arXiv:2610.06685},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.06685},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f3a4733fc9cf; sha256 c6e7fb7986bb6966f58f6d9db3201508849b7b2a020597f904639ef705ee28d5},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.06685. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Clinical questions often depend on linking a patient's multimodal evidence to external biomedical knowledge, yet existing predictive systems rarely represent such links explicitly, so they can neither be traced to their evidence sources nor removed to measure their contributions. We present MM-KG (Multimodal Knowledge Graph), which represents heterogeneous, multimodal patient observations and biomedical concepts as separate layers in one typed graph, joined by explicit alignment edges. First, modality-specific harmonizers convert EHR text, imaging, genomic, and biospecimen data into typed observations mapped to UMLS concepts, which a route-prioritized aligner links to a biomedical knowledge graph. Query-conditioned retrieval then selects a compact subgraph for downstream use by a large language model or a graph neural network. We build MM-KGs for MIMIC-IV and ADNI, and evaluate them with a 2x2 design that separates patient evidence, biomedical knowledge, and their interaction. On questions that require both sources, neither source alone performs far above chance, whereas their combination yields a drug-controlled AUROC interaction of +0.194 on MIMIC and +0.299 on ADNI. On held-out five-candidate ranking, MM-KG outperforms MindMap by +0.131 Hits@1 and leads an adapted GraphCare on the items that require consulting the patient, and deleting the single answer-bearing relation from the retrieved packet returns Hits@1 to the no-knowledge baseline. Finally, query-conditioned retrieval reaches 0.731 AUROC with 6.8x less context than the strongest generic policy, whereas static knowledge graph context gives no consistent gain on ordinary outcome prediction. Knowledge graphs thus benefit clinical LLMs not as background context but as explicit links between multimodal patient evidence and the relation a question requires, and MM-KG makes these links retrievable, traceable, and testable.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2610.06685 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:24:20.472Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).