Metraipolis › archive › dc_9f7bf52cc68f

PathKGen: Pathology Knowledge Assisted MLLM for Explainable Histopathology — arXiv:2610.33691

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.33691
License (as archived)
CC0-1.0
Archived
2026-10-27T08:12:37.080Z
SHA-256 of the archived text
a8845af72eee098b6ce59b7cfa8151a60187713233ff62881a7895c49a7fdc61
Stable URL of this page
https://metraipolis.com/documento/dc_9f7bf52cc68f

How to cite

PathKGen: Pathology Knowledge Assisted MLLM for Explainable Histopathology — arXiv:2610.33691 — arXiv (en), https://arxiv.org/abs/2610.33691 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9f7bf52cc68f (Metraipolis archive dc_9f7bf52cc68f, sha256 a8845af72eee098b6ce59b7cfa8151a60187713233ff62881a7895c49a7fdc61)
BibTeX
@misc{dc9f7bf52cc68f,
  title = {PathKGen: Pathology Knowledge Assisted MLLM for Explainable Histopathology — arXiv:2610.33691},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.33691},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9f7bf52cc68f; sha256 a8845af72eee098b6ce59b7cfa8151a60187713233ff62881a7895c49a7fdc61},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.33691. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Whole Slide Image (WSI) analysis serves as the fundamental method for the clinical diagnosis of cancer in digital histopathology. Recent advances in Multimodal Large Language Models (MLLMs) have enabled state-of-the-art (SOTA) automated histopathology report generation. However, MLLMs reason purely through distributions encoded in their neural parameters, limiting the amount of knowledge and reasoning logic they can contain given the model scale. Their black-box reasoning poses another challenge to the human interpretation of intermediate reasoning. We address these issues by utilizing knowledge graphs to inject external structured knowledge for MLLMs to reason over, while making this reasoning component visible. Knowledge graphs are capable of partially externalizing the containment of medical knowledge, an area that remains underexplored in pathology report generation. We introduce PathKGen, a knowledge graph-assisted MLLM for histopathology report generation. PathKGen has two main branches: (1) a visual path that learns visual token inputs to the MLLM using pathology foundation models, and (2) a knowledge path that learns knowledge token inputs by extracting key morphological features of WSIs through querying a pathology-specific knowledge graph. A comprehensive evaluation on WSI-Bench dataset shows that PathKGen surpasses previous SOTA methods while revealing diagnostic reasoning as visually intuitive graphs. Due to its modular design, the proposed knowledge path is complementary to vision-aligned MLLMs and can be extended to other applications by curating domain-specific knowledge graphs to generate knowledge tokens.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2610.33691 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-27T07:56:00.293Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).