Metraipolis › archive › dc_9151088e33ea
CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving — arXiv:2609.32157
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.32157
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T23:50:44.212Z
- SHA-256 of the archived text
075756859763b69ae27916653a158c95e2b397b3ce0da116b4086926e4af3a96- Stable URL of this page
https://metraipolis.com/documento/dc_9151088e33ea
How to cite
CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving — arXiv:2609.32157 — arXiv (en), https://arxiv.org/abs/2609.32157 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9151088e33ea (Metraipolis archive dc_9151088e33ea, sha256 075756859763b69ae27916653a158c95e2b397b3ce0da116b4086926e4af3a96)
BibTeX
@misc{dc9151088e33ea,
title = {CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving — arXiv:2609.32157},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.32157},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9151088e33ea; sha256 075756859763b69ae27916653a158c95e2b397b3ce0da116b4086926e4af3a96},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.32157. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Vision-Language-Action (VLA) models for autonomous driving produce natural-language reasoning alongside predicted trajectories, but whether this reasoning reflects the causal structure of the scene remains untested. We introduce CausalDriveBench, an evaluation framework grounded in Pearl's Causal Hierarchy (PCH) that tests causal reasoning in driving-specific VLAs through structured visual question answering (QA) and alternative-trajectory prediction. To this end, we construct causal scene graphs over nuScenes that distinguish causally active, dormant, and distractor entities, separating perceptual salience from causal relevance. The benchmark spans all four rungs of PCH (association, intervention, and counterfactual along with causal discovery) for QA generation. For the higher rungs, we additionally provide reference trajectories under specified scene modifications, enabling action-level verification that complements reasoning-level evaluation. In total, the benchmark contains 7,285 verified causal QA pairs and 1,000 counterfactual trajectories derived from nuScenes. We evaluate 10 driving-specific VLAs and 3 general-purpose VLMs, and report three findings. First, the best model reaches only 70.6% QA accuracy, and 4 of 13 models score below random chance. Second, comparing each driving VLA to the general-purpose VLM that shares its language backbone, the cost of driving fine-tuning ranges from 2 to 34 percentage points on causal QA, with post-training design explaining the spread. Third, causal QA and trajectory accuracy are statistically uncorrelated across models: under counterfactual prompts, predicted trajectories either over-react or collapse onto the observed-scene baseline. Taken together, these results show that neither fluent rationales nor accurate observed-scene trajectories constitute evidence of causal understanding. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Robotics (cs.RO). Pagina del lavoro: https://arxiv.org/abs/2609.32157 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T23:29:26.968Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).