Metraipolis › archive › dc_e3cedc05a32e

What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts — arXiv:2609.12085

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.12085
License (as archived)
CC0-1.0
Archived
2026-10-16T03:08:16.067Z
SHA-256 of the archived text
12ff6879115ae5af47be4553141202b22927a643de8c3c2dbb78a9708f72ec2d
Stable URL of this page
https://metraipolis.com/documento/dc_e3cedc05a32e

How to cite

What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts — arXiv:2609.12085 — arXiv (en), https://arxiv.org/abs/2609.12085 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e3cedc05a32e (Metraipolis archive dc_e3cedc05a32e, sha256 12ff6879115ae5af47be4553141202b22927a643de8c3c2dbb78a9708f72ec2d)
BibTeX
@misc{dce3cedc05a32e,
  title = {What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts — arXiv:2609.12085},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.12085},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e3cedc05a32e; sha256 12ff6879115ae5af47be4553141202b22927a643de8c3c2dbb78a9708f72ec2d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.12085. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Checking Quran recitation from an ASR transcript requires distinguishing unresolved mistakes from repetitions, repairs, opening formulas and accepted spelling differences. We report a completed human annotation of 100 production recording cases: 348 scored units and 162 localized events across ten combined labels. An executable evaluator scores labels and word positions together. A plain diff reaches label-aware F1 0.525 and localization F1 0.826; adapted production cleaner/alignment components reach 0.518 and 0.786, with exact-span F1 0.505 for both. Correcting the adapter's word coordinates recovers all five annotated repetition events, showing why annotation interfaces must be checked before interpreting baseline failures. In a preliminary pilot, eight single 20-minute runs across three coding agents and eight models span label-aware F1 0.143 to 0.892: seven land far above every baseline, and one collapses below the naive diff from a missing normalization step. Across the six, 970 of 972 gold-event instances draw an overlapping prediction, so what remains is not detection but convention: span extent, and the labels whose boundary is stipulated by adjudication rather than visible in the text. Seven of 162 events defeat all six same-day runs, five of them one orthographic rule, and the strongest run still misses the same ones. No run annotated before building, so the pilot measures the algorithm half of the task only.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-14 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.12085 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T03:02:47.525Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-14?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).