Metraipolis › archive › dc_52db030998de

A Comparative Evaluation of Digitization Pipelines for Historiographical Sources — arXiv:2608.24976

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.24976
License (as archived)
CC0-1.0
Archived
2026-10-18T01:27:28.680Z
SHA-256 of the archived text
553824ddf077b3673a5a27804580a5687336b5d52a1bb47e53e96c665f73060e
Stable URL of this page
https://metraipolis.com/documento/dc_52db030998de

How to cite

A Comparative Evaluation of Digitization Pipelines for Historiographical Sources — arXiv:2608.24976 — arXiv (en), https://arxiv.org/abs/2608.24976 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_52db030998de (Metraipolis archive dc_52db030998de, sha256 553824ddf077b3673a5a27804580a5687336b5d52a1bb47e53e96c665f73060e)
BibTeX
@misc{dc52db030998de,
  title = {A Comparative Evaluation of Digitization Pipelines for Historiographical Sources — arXiv:2608.24976},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.24976},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_52db030998de; sha256 553824ddf077b3673a5a27804580a5687336b5d52a1bb47e53e96c665f73060e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.24976. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Purpose: The digitization of historical documents presents fundamental challenges for modern information retrieval and Artificial Intelligence (AI) systems. Optical character recognition (OCR) errors in source corpora propagate through retrieval-augmented generation (RAG) pipelines, compromising the factual accuracy of generated outputs. Methods: This study presents a systematic evaluation of PDF-to-text extraction pipelines applied to historiographical secondary sources on the Visigothic period. We assess thirteen distinct approaches spanning three methodological families: direct extraction, Large Language Model (LLM) post-correction, and chunk-and-extract. Documents are stratified into five categories based on production method and visual complexity. Performance is measured using character error rate (CER) and word error rate (WER) against manually corrected ground truth. Results: Results demonstrate that direct extraction with Marker achieves superior performance (98.70% CER accuracy; 97.71% WER accuracy overall), while conventional OCR pipelines exhibit substantial degradation on scanned documents and complex layouts. Embedded-text extraction performs well on digital PDFs but fails on scanned documents. LLM post-correction does not provide systematic improvements and frequently degrades accurate extractions. Conclusion: End-to-end document parsing is the most reliable approach for heterogeneous historical collections. Document characteristics such as scan quality, layout complexity, and the presence of embedded text layers have a significant impact on extraction accuracy. LLM-based post-correction should not be assumed beneficial by default and requires validation before large-scale application.

Tema degli esploratori: ricerca e scienza aperta (retro-catalogo arXiv: annunci del 2026-08-27 in cs.DL).
Categorie arXiv: Digital Libraries (cs.DL).
Pagina del lavoro: https://arxiv.org/abs/2608.24976 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T01:27:21.256Z dalla pagina https://arxiv.org/catchup/cs.DL/2026-08-27?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).