Metraipolis › archive › dc_f50f8f004ee9

AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents — arXiv:2609.05802

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.05802
License (as archived)
CC0-1.0
Archived
2026-10-16T12:34:45.587Z
SHA-256 of the archived text
0bcdacb8a8b24ad038f8dcf9b6a0173e0bd1ee870515486b06b0578326af1bcd
Stable URL of this page
https://metraipolis.com/documento/dc_f50f8f004ee9

How to cite

AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents — arXiv:2609.05802 — arXiv (en), https://arxiv.org/abs/2609.05802 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f50f8f004ee9 (Metraipolis archive dc_f50f8f004ee9, sha256 0bcdacb8a8b24ad038f8dcf9b6a0173e0bd1ee870515486b06b0578326af1bcd)
BibTeX
@misc{dcf50f8f004ee9,
  title = {AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents — arXiv:2609.05802},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.05802},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f50f8f004ee9; sha256 0bcdacb8a8b24ad038f8dcf9b6a0173e0bd1ee870515486b06b0578326af1bcd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.05802. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models answering questions over multi-page documents are expected to cite the supporting pages, yet supplied citations are sometimes inaccurate, and current evaluations score citations at generation time or against text passages: no existing benchmark evaluates whether a system can verify and correct a page-level citation already attached to an answer. We propose AtomCite, an agentic framework that parses an answer into claims, checks each claim against the image of its cited page, and applies a deterministic repair policy. To evaluate it, we introduce DocCite, to our knowledge the first benchmark for systems that verify and correct page-level citations in document images. Built on MP-DocVQA and DUDE, it combines 928 validated injected instances with 2,468 candidate natural errors harvested from frontier- and efficiency-tier models, of which a two-annotator audit confirms 1,909 as genuine errors. Primary labels are assigned deterministically, not by LLM judges, with the human audit as a separate validation layer. Across three model families (Gemini, Claude, and GPT), AtomCite reaches around 93% binary verification accuracy on the injected benchmark, significantly outperforming every OCR-only condition, including a compute-matched control, and exceeding every prior text-based baseline given the same OCR text. Its repair policy lifts citation precision on the injected mix from a constructed 34% to 87-90% while retaining over 90% of correct claims. AtomCite also transfers: with frozen prompts and zero training, it raises the hallucination-detection scores of two open 7-8B models on five public benchmarks above the same models prompted as direct judges. Finally, the audit shows that noise in automatic labels biases measured verifier accuracy and can reverse system rankings, so evaluations relying only on synthetic or automatic labels risk mismeasuring verification capability.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Information Retrieval (cs.IR).
Pagina del lavoro: https://arxiv.org/abs/2609.05802 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T12:30:24.986Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).