Metraipolis › archive › dc_2080cddddb3e
PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian — arXiv:2609.00958
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.00958
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T06:41:26.094Z
- SHA-256 of the archived text
05bc183d61ca57c06e7fb4e59aedd8d2991c9cd9ea9e58b8fa48f256b396a228- Stable URL of this page
https://metraipolis.com/documento/dc_2080cddddb3e
How to cite
PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian — arXiv:2609.00958 — arXiv (en), https://arxiv.org/abs/2609.00958 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2080cddddb3e (Metraipolis archive dc_2080cddddb3e, sha256 05bc183d61ca57c06e7fb4e59aedd8d2991c9cd9ea9e58b8fa48f256b396a228)
BibTeX
@misc{dc2080cddddb3e,
title = {PersianAnonymizer: Evaluating LLM-Labeled Training for Efficient NER-based Anonymization in Persian — arXiv:2609.00958},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.00958},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2080cddddb3e; sha256 05bc183d61ca57c06e7fb4e59aedd8d2991c9cd9ea9e58b8fa48f256b396a228},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.00958. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We target practical anonymization of Persian customer chats by training a compact NER model from LLM-labeled supervision and selecting the best labeler for deployment. We compare three instruction-tuned LLMs: DeepSeek-V3-0324, GPT-OSS-120B, and Qwen3-235B-A22B-Instruct-2507, to produce span annotations under a shared JSON protocol, yielding four corpora (OSS_ZeroShot, Qwen_ZeroShot, Qwen_FewShot, DeepSeek_FewShot). A MatinaRoberta-based token-classifier is trained per corpus and evaluated with token-level Precision/Recall/F1 (overall and per-class). We also report Label Coverage Recall (LCR), the proportion of gold non-O tokens predicted as non-O, and quantify cross-labeler behavior via a token-level Venn on test annotations. Finally, we contrast test-set annotation latency of the LLMs on H200 nodes with the trained NER's test-time labeling on a single RTX 3090. Results show that supervision from OSS_ZeroShot yields the strongest macro-F1 and LCR, while the resulting NER labels an entire 40K-message test set in approximately 2 minutes on one consumer GPU. This establishes a practical path to high-quality, low-cost anonymization for Persian industrial data. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.00958 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T06:33:38.836Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).