Metraipolis › archive › dc_0113b5b288fe
URL Extraction from Scholarly Documents: A Cross-Format Comparative Analysis — arXiv:2609.08019
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.08019
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T13:39:18.503Z
- SHA-256 of the archived text
281ad5d65872fb1c6f504acdcea85156d1e74486c1283d1627570ef5837f1797- Stable URL of this page
https://metraipolis.com/documento/dc_0113b5b288fe
How to cite
URL Extraction from Scholarly Documents: A Cross-Format Comparative Analysis — arXiv:2609.08019 — arXiv (en), https://arxiv.org/abs/2609.08019 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0113b5b288fe (Metraipolis archive dc_0113b5b288fe, sha256 281ad5d65872fb1c6f504acdcea85156d1e74486c1283d1627570ef5837f1797)
BibTeX
@misc{dc0113b5b288fe,
title = {URL Extraction from Scholarly Documents: A Cross-Format Comparative Analysis — arXiv:2609.08019},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.08019},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0113b5b288fe; sha256 281ad5d65872fb1c6f504acdcea85156d1e74486c1283d1627570ef5837f1797},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.08019. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
URLs in scholarly documents link to rich external resources such as datasets, software, publications, and websites. Extracting these URLs is crucial in the data preparation stage of many downstream tasks, such as link rot analysis, web crawling, and building knowledge graphs. However, existing studies often downplay this phase, simply extracting URLs from a single format, usually text directly converted from PDFs. We present a systematic study evaluating URL extraction across six input formats (text with annotation layer, LaTeX, HTML, XML, Markdown, and PNG converted from PDF). To support the evaluation, we compiled a benchmark dataset consisting of 2,338 manually annotated URLs from 200 arXiv papers spanning a wide range of domains over a 33-year period. In addition to evaluating individual file formats, we also compared 63 composite input-format combinations. Our extensive evaluations indicate that TEXTWAL achieves the best performance among single-format inputs, while TEXTWAL+LaTeX achieves the best overall URL extraction performance. The same trend is observed for URLs linking to open-access datasets and software. To further validate these findings, we apply our format-specific URL extraction pipelines to a longitudinal random sample of 364,744 arXiv papers spanning 33 years. We observe a sharp increase in URL density after 2015, along with remarkable differences in URL extraction across file formats over time. Overall, our study highlights the importance of selecting an appropriate format for URL extraction from scholarly documents. The dataset and code are publicly available at: this https URL . Tema degli esploratori: ricerca e scienza aperta (retro-catalogo arXiv: annunci del 2026-09-09 in cs.DL). Categorie arXiv: Digital Libraries (cs.DL). Pagina del lavoro: https://arxiv.org/abs/2609.08019 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T13:07:26.882Z dalla pagina https://arxiv.org/catchup/cs.DL/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).