Metraipolis › archive › dc_4c4e53909bef
Labadain-MedQA: A Tetun Medical QA Dataset for Fine-Tuning and Evaluating Large Language Models — arXiv:2611.00935
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.00935
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T10:46:12.757Z
- SHA-256 of the archived text
73c9bb72e6ba558b66dfbb97e7e3814704aaf0c19df5ef905d51cc76492a576c- Stable URL of this page
https://metraipolis.com/documento/dc_4c4e53909bef
How to cite
Labadain-MedQA: A Tetun Medical QA Dataset for Fine-Tuning and Evaluating Large Language Models — arXiv:2611.00935 — arXiv (en), https://arxiv.org/abs/2611.00935 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4c4e53909bef (Metraipolis archive dc_4c4e53909bef, sha256 73c9bb72e6ba558b66dfbb97e7e3814704aaf0c19df5ef905d51cc76492a576c)
BibTeX
@misc{dc4c4e53909bef,
title = {Labadain-MedQA: A Tetun Medical QA Dataset for Fine-Tuning and Evaluating Large Language Models — arXiv:2611.00935},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.00935},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4c4e53909bef; sha256 73c9bb72e6ba558b66dfbb97e7e3814704aaf0c19df5ef905d51cc76492a576c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00935. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Advances in large language models (LLMs) have created opportunities for cross-lingual transfer of medical knowledge from high-resource to low-resource languages to support access to healthcare information. However, medical question-answering (QA) datasets for fine-tuning and evaluating LLMs remain scarce for Tetun. To address this gap, we translated MedAlpaca's Medical Flashcards and WikiDoc Patient Information collections into Tetun using Gemini 2.5 Flash, producing 39,077 medical QA pairs. Translation quality was assessed on 50 randomly sampled QA pairs (100 documents) using automatic metrics against human reference translations and evaluations by two native Tetun-speaking healthcare professionals, focusing on medical accuracy and Tetun fluency. Human translations achieved higher mean ratings than LLM-generated translations for both criteria (4.43/5 vs. 4.02/5), with statistically significant differences (Wilcoxon signed-rank test, p < 0.001). To assess downstream utility, we fine-tuned Gemma and Llama variants on the translated MedAlpaca dataset using parameter-efficient fine-tuning (PEFT) and evaluated them on 325 Tetun-translated United States Medical Licensing Examination multiple-choice questions. Gemma 4 12B fine-tuned using QLoRA achieved relative improvements in mean accuracy of 10.79% with 4-bit NormalFloat (NF4) inference and 10.42% after merging the LoRA adapters into the BF16 base model, compared with the corresponding base models. These results highlight the viability of automatic dataset translation for Tetun medical QA and the effectiveness of PEFT in enhancing model performance. The datasets, models, and evaluation resources are accessible at this https URL to support reproducible research on Tetun medical QA and facilitate machine translation, cross lingual, and multilingual research. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.00935 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T10:39:50.439Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).