Metraipolis › archive › dc_16fa4be2b6b5

Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR — arXiv:2610.20461

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.20461
License (as archived)
CC0-1.0
Archived
2026-10-15T20:03:03.038Z
SHA-256 of the archived text
11f9622a04d2b9e68a0e906d1fb41b8f0bed26d7c9c5bca9ece50efa3e878ccd
Stable URL of this page
https://metraipolis.com/documento/dc_16fa4be2b6b5

How to cite

Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR — arXiv:2610.20461 — arXiv (en), https://arxiv.org/abs/2610.20461 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_16fa4be2b6b5 (Metraipolis archive dc_16fa4be2b6b5, sha256 11f9622a04d2b9e68a0e906d1fb41b8f0bed26d7c9c5bca9ece50efa3e878ccd)
BibTeX
@misc{dc16fa4be2b6b5,
  title = {Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR — arXiv:2610.20461},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.20461},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_16fa4be2b6b5; sha256 11f9622a04d2b9e68a0e906d1fb41b8f0bed26d7c9c5bca9ece50efa3e878ccd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.20461. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Character Error Rate (CER), the standard metric for OCR and vision-language models (VLMs), charges a typo as much as a wrong name. We introduce semCER, which keeps CER's alignment and denominator and charges each grapheme edit a severity from an LLM judge, with no word segmentation. Normalized CER keeps the score of a whole transcription, where it tracks readers as well as semCER or better, and semCER breaks that score down into named edits. The charges track readers' ratings edit by edit in English, Vietnamese, and Chinese and put the edits readers rate most severe near the top of a sorted list. On pairs drawn where CER and semCER disagreed, readers side with semCER more often than with normalized CER in English and Chinese, and equally often in Vietnamese. Across 16 languages, the judge charges a wrong diacritic or tone mark almost nothing in Spanish but nearly a wrong letter's severity in Telugu. Where we can count real words, a general VLM's wrong letter forms one far above chance while a classical pipeline's stays near it. We release the 61 million judged edits, the aggregated reader ratings, and the distilled scorer at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.20461 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T19:35:48.427Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).