Metraipolis › archive › dc_e03e623a3c00
Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa — arXiv:2610.22110
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.22110
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T10:02:00.544Z
- SHA-256 of the archived text
1a7e0a2b4d77e9da18757342130bcd7ed0c6e038110906ba154c597f5ab229bc- Stable URL of this page
https://metraipolis.com/documento/dc_e03e623a3c00
How to cite
Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa — arXiv:2610.22110 — arXiv (en), https://arxiv.org/abs/2610.22110 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e03e623a3c00 (Metraipolis archive dc_e03e623a3c00, sha256 1a7e0a2b4d77e9da18757342130bcd7ed0c6e038110906ba154c597f5ab229bc)
BibTeX
@misc{dce03e623a3c00,
title = {Unfragmenting Nawatl NMT: Single-Variant Specialization for Masewalkopa — arXiv:2610.22110},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.22110},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e03e623a3c00; sha256 1a7e0a2b4d77e9da18757342130bcd7ed0c6e038110906ba154c597f5ab229bc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.22110. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
In minoritized (low-resource) language technologies, a common response to data sparsity is to aggregate text across multiple varieties and treat the combined data as a single corpus. However, mixed corpora of closely related indigenous variants can produce an artificial register that is accountable to no single speaker community, a structural failure we call variant fragmentation. This issue is acute for minoritized languages native to Mexico, such as Nawatl. Building on a 70,000-pair multi-variant foundation, we specialize an mT5-large checkpoint to Masewalkopa (nhn), the Nawatl variety spoken in Santa Ana Tlacotenco. We curate 2,665 parallel pairs, reserve all sentence-level data for evaluation, and incorporate 192 elder-transcribed target sentences via asymmetric backtranslation. A custom finite-state analyzer reduces unanalyzed surface forms from 82.0% to 19.9% and supplies functional syntax tags as plain-text prefixes, allowing the model to reuse existing subword embeddings rather than relying on frozen special tokens. The resulting LoRA-v9c-b model achieves 58.46 dev chrF++ and 58.20/57.90 directional test chrF++. Finally, CTranslate2 int8 quantization reduces CPU latency from 137.5 to 1.8-2.6 seconds per request, enabling cost-bounded Cloud Run deployment. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2610.22110 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T08:44:47.691Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).