Metraipolis › archive › dc_ee1c846db303
Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels — arXiv:2608.30827
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.30827
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T08:07:45.652Z
- SHA-256 of the archived text
cd132c1b931ab646b869f0a41e4d88ff65c9a0579f09217fc560e2a3868f6313- Stable URL of this page
https://metraipolis.com/documento/dc_ee1c846db303
How to cite
Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels — arXiv:2608.30827 — arXiv (en), https://arxiv.org/abs/2608.30827 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ee1c846db303 (Metraipolis archive dc_ee1c846db303, sha256 cd132c1b931ab646b869f0a41e4d88ff65c9a0579f09217fc560e2a3868f6313)
BibTeX
@misc{dcee1c846db303,
title = {Error-Type-Aware Loss Reweighting for Robust Named Entity Recognition with Noisy LLM Labels — arXiv:2608.30827},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.30827},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ee1c846db303; sha256 cd132c1b931ab646b869f0a41e4d88ff65c9a0579f09217fc560e2a3868f6313},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30827. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models are increasingly used to annotate datasets for training smaller, task-specialized models such as named entity recognition. While this method yields effective models, it assumes that the synthetic dataset is correctly annotated. In this work, we find that (i) current fine-tuning processes simply ignore LLM-introduced annotation noise, resulting in degraded performance and (ii) existing noise-robust losses are not transferable to sequence labeling because annotation noise in named entity recognition is heterogeneous: for example, missing mentions and type errors affect the training signal in different ways. Treating all noisy tokens equally in noise-robust losses and applying a single reweighing criterion for all may therefore remove useful supervision or reinforce incorrect labels. To address this limitation, we propose error-type-aware loss reweighting for NER, which introduces separate reweighing rules for different types of potentially erroneous tokens. Our approach is simple and efficient, does not require additional training resources, and improves F1 by 0.8 - 2.0 percentage points on dataset-level average for noise levels between 15% and 40%, with a maximum improvement of 4.6 percentage points with 24.1% noise on Wikigold. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2608.30827 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T07:47:52.855Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).