Metraipolis › archive › dc_f1583bc3faa0
Before the Token Commits: Trajectory-Level Benchmarking of Visual Hallucinations in Diffusion VLMs — arXiv:2609.34772
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.34772
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T20:58:09.230Z
- SHA-256 of the archived text
4d9c88c7460f977fcb4c4b869f94a25e319f4421359c1cca5479d9491dc13937- Stable URL of this page
https://metraipolis.com/documento/dc_f1583bc3faa0
How to cite
Before the Token Commits: Trajectory-Level Benchmarking of Visual Hallucinations in Diffusion VLMs — arXiv:2609.34772 — arXiv (en), https://arxiv.org/abs/2609.34772 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f1583bc3faa0 (Metraipolis archive dc_f1583bc3faa0, sha256 4d9c88c7460f977fcb4c4b869f94a25e319f4421359c1cca5479d9491dc13937)
BibTeX
@misc{dcf1583bc3faa0,
title = {Before the Token Commits: Trajectory-Level Benchmarking of Visual Hallucinations in Diffusion VLMs — arXiv:2609.34772},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.34772},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f1583bc3faa0; sha256 4d9c88c7460f977fcb4c4b869f94a25e319f4421359c1cca5479d9491dc13937},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.34772. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multimodal diffusion language models generate responses by iteratively unmasking tokens, making each answer the endpoint of a multi-step trajectory rather than an immediate commitment. Hallucination benchmarks built for autoregressive models evaluate only the final output, and therefore cannot determine whether an unsupported claim in diffusion VLMs appears late or has already stabilized before any answer token is revealed. We introduce DynaHall, a trajectory-level benchmark of annotation-backed binary visual propositions covering object existence, counting, attributes, and relations, with controlled hard negatives graded by visual prior. DynaHall is paired with a commitment-aware protocol that records the intermediate answer tendency at every unmasking step alongside the committed output. Across five diffusion VLMs from three architecture families, visual hallucination is settled before commitment: an unsupported answer is already the preferred state while the answer position is still masked, and later unmasking steps rarely reverse it, so the failure is not introduced at the write step. This holds across decoding schedules, answer formats, and open-ended generation. DynaHall also exposes failures hidden by final-output metrics, including counting and relation collapse, prior-driven false positives, and attribute errors whose direction changes by type. Guided by this diagnosis, PGS (Pre-commitment Gradient Steering) edits still-masked answer states to reduce false positives, bringing the affirmation rate close to balance, and transfers to another architecture without degrading general ability. DynaHall and PGS suggest that hallucination should be measured and mitigated along the generation trajectory of diffusion VLMs, not only at the final answer. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.34772 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:01.657Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).