Metraipolis › archive › dc_3254d3c8cbac
TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection — arXiv:2609.18748
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.18748
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T13:50:00.438Z
- SHA-256 of the archived text
37b88abbff9317d60d5d6ff378c44f9dcfd5ce8b99471272877fc17d84c8f4e9- Stable URL of this page
https://metraipolis.com/documento/dc_3254d3c8cbac
How to cite
TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection — arXiv:2609.18748 — arXiv (en), https://arxiv.org/abs/2609.18748 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3254d3c8cbac (Metraipolis archive dc_3254d3c8cbac, sha256 37b88abbff9317d60d5d6ff378c44f9dcfd5ce8b99471272877fc17d84c8f4e9)
BibTeX
@misc{dc3254d3c8cbac,
title = {TeleAntiFraud 2.0: A Refreshable, Profile-Grounded, and Audio-Based Benchmark for Telecom Fraud Detection — arXiv:2609.18748},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.18748},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3254d3c8cbac; sha256 37b88abbff9317d60d5d6ff378c44f9dcfd5ce8b99471272877fc17d84c8f4e9},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.18748. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Telecom fraud scripts evolve rapidly and are often designed to resemble routine service conversations, creating two key requirements for audio-based telecom-fraud evaluation. First, benchmarks must incorporate newly observed scam patterns without overwriting previously established test sets. Second, they must distinguish fraud from lawful, near-domain calls rather than relying on topic-separated negative examples. We present TeleAntiFraud 2.0, constructed with our Mixed-Tree Anti-Fraud Generation Pipeline and evaluated under a monthly frozen evaluation protocol. The pipeline transforms online fraud-case abstracts into profile-grounded scenarios, expands them through mixed-tree generation, realizes fraud and non-fraud dialogue paths under shared contexts, renders validated dialogues as role-matched speech, and freezes the resulting audio, labels, prompts, manifests, and provenance records for each monthly evaluation set. Each frozen set contains 900 Chinese calls, comprising 600 fraud and 300 near-domain non-fraud cases. Controlled text experiments show that three classifiers achieve perfect macro-averaged F1 (Macro-F1) when evaluated against unrelated or ordinary negatives, but drop to 0.65-0.68 with near-domain sibling negatives. Full-set audio and automatic-speech-recognition plus large-language-model (ASR+LLM) evaluations further reveal class-prior shortcuts, prediction collapse, and snapshot sensitivity. Together, these findings establish near-domain construction and collapse-aware reporting as core requirements for evaluating audio-based telecom-fraud models under realistic confusable conditions. The accompanying research artifact includes the construction code, evaluation scripts, manifests, and documentation. Our dataset and code are available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-17 in cs.CL). Categorie arXiv: Sound (cs.SD) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.18748 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T13:48:24.433Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).