Metraipolis › archive › dc_032ba9d25a82

CardioLM: A multilingual suite of small language models for the cardiology domain — arXiv:2611.07940

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.07940
License (as archived)
CC0-1.0
Archived
2026-11-06T14:42:46.863Z
SHA-256 of the archived text
ec3cc5e6727822fc507f6e58d6c7fd09b9da7f59a19d37ebd6c3fe4e06fa8a7d
Stable URL of this page
https://metraipolis.com/documento/dc_032ba9d25a82

How to cite

CardioLM: A multilingual suite of small language models for the cardiology domain — arXiv:2611.07940 — arXiv (en), https://arxiv.org/abs/2611.07940 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_032ba9d25a82 (Metraipolis archive dc_032ba9d25a82, sha256 ec3cc5e6727822fc507f6e58d6c7fd09b9da7f59a19d37ebd6c3fe4e06fa8a7d)
BibTeX
@misc{dc032ba9d25a82,
  title = {CardioLM: A multilingual suite of small language models for the cardiology domain — arXiv:2611.07940},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.07940},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_032ba9d25a82; sha256 ec3cc5e6727822fc507f6e58d6c7fd09b9da7f59a19d37ebd6c3fe4e06fa8a7d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07940. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Background: Cardiovascular care generates large volumes of clinical free-text documentation in local languages. However, clinical natural language processing (NLP) resources remain concentrated in English, and no existing benchmark is cardiology-specific, multilingual, and broad in entity coverage. Methods: We present two contributions. The first is CardioCCC, a corpus of 508 cardiology case reports originally published in Spanish and extended to Czech, Dutch, English, Italian, Romanian, and Swedish through machine translation, annotation projection, and clinician review, with annotations covering diseases, symptoms, procedures, and medications. The second is CardioLM, comprising CardioBERTa, a set of language-specific encoders obtained by continued pretraining on cardiology and biomedical corpora, and CardioNER, a set of named entity recognition (NER) models fine-tuned on CardioCCC. Results: Cardiology-specific pretraining reduced pseudo-perplexity by up to a factor of eight, yet changed strict span-level F1 by at most 0.04, with benefits concentrated in languages whose backbones lacked biomedical coverage. The jointly trained multilingual XLM-RoBERTa-large models achieved the best strict F1 in nearly every language and entity type, exceeding the strongest monolingual system by up to 0.13 F1. A large share of residual errors concerned boundary detection: relaxed matching recovered 0.10-0.23 F1 for disease, procedure, and symptom, but only 0.01-0.07 for medication. Clinicians rated CardioNER well above a rule- and dictionary-based baseline, with the mean rating across entity types rising from 26% to 73%. Conclusions: Specialty-specific pretraining is not the decisive factor for downstream entity recognition, whereas multilingual joint training yields the strongest results in nearly all settings and a simpler deployment path for multi-country clinical information extraction.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.07940 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:18:42.695Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).