Metraipolis › archive › dc_446061ff104d

Language Specificity vs. Domain Diversity: Benchmarking Transformers for Bangla Medical NER — arXiv:2609.29101

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29101
License (as archived)
CC0-1.0
Archived
2026-10-08T05:25:53.214Z
SHA-256 of the archived text
0a7c2b486988d28e4c24224f5e413c1b2363b238c3d71491bbb77b4bafc7391b
Stable URL of this page
https://metraipolis.com/documento/dc_446061ff104d

How to cite

Language Specificity vs. Domain Diversity: Benchmarking Transformers for Bangla Medical NER — arXiv:2609.29101 — arXiv (en), https://arxiv.org/abs/2609.29101 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_446061ff104d (Metraipolis archive dc_446061ff104d, sha256 0a7c2b486988d28e4c24224f5e413c1b2363b238c3d71491bbb77b4bafc7391b)
BibTeX
@misc{dc446061ff104d,
  title = {Language Specificity vs. Domain Diversity: Benchmarking Transformers for Bangla Medical NER — arXiv:2609.29101},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29101},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_446061ff104d; sha256 0a7c2b486988d28e4c24224f5e413c1b2363b238c3d71491bbb77b4bafc7391b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29101. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Medical Named Entity Recognition (NER) for low-resource languages remains a challenging task due to high linguistic variability and a scarcity of domain-specific annotated corpora. This work presents a comprehensive empirical benchmark evaluating three fine-tuned transformer encoders-BanglaBERT, multilingual BERT (mBERT), and XLM-RoBERTa-against GPT-4o mini under zero-shot and few-shot prompting configurations for Bangla medical NER. In contrast to prior studies that evaluated large language models on limited subsets of only 50 samples, we conduct a large-scale evaluation across the full test set of 3,179 samples, providing statistically robust and reproducible baselines. Our fine-tuned XLM-RoBERTa model achieves an F1- score of 0.5959, establishing a new state-of-the-art and surpassing the previously reported best result of 0.5848. Crucially, we demonstrate that the language-specific BanglaBERT model consistently underperforms its multilingual counterparts with an F1-score of 0.4937, indicating that pretraining domain diversity can outweigh language specificity in highly specialized clinical settings. Furthermore, we present a detailed per-entity-type analysis for this task, revealing that Medicine and Specialist categories are recognized with high reliability, achieving F1- scores above 0.83, while the Symptom category remains the most challenging with an F1-score of 0.4367 despite being the most frequent training class. Finally, fine-tuned transformer models outperform the optimal prompting configuration by a factor of 3.76, confirming that prompt-only pipelines remain inadequate for structured clinical entity extraction in low-resource language environments.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-25 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.29101 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T04:50:39.332Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).