Metraipolis › archive › dc_ef8091e94099
doPlan: A Variable-Horizon Dataset for Multi-Stage Language-Conditioned Planning in Autonomous Driving — arXiv:2609.38028
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.38028
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T16:28:02.791Z
- SHA-256 of the archived text
e6a006611b3df10b25f39668e374e10827debff94eaace6477113d2b7c4da5cd- Stable URL of this page
https://metraipolis.com/documento/dc_ef8091e94099
How to cite
doPlan: A Variable-Horizon Dataset for Multi-Stage Language-Conditioned Planning in Autonomous Driving — arXiv:2609.38028 — arXiv (en), https://arxiv.org/abs/2609.38028 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ef8091e94099 (Metraipolis archive dc_ef8091e94099, sha256 e6a006611b3df10b25f39668e374e10827debff94eaace6477113d2b7c4da5cd)
BibTeX
@misc{dcef8091e94099,
title = {doPlan: A Variable-Horizon Dataset for Multi-Stage Language-Conditioned Planning in Autonomous Driving — arXiv:2609.38028},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.38028},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ef8091e94099; sha256 e6a006611b3df10b25f39668e374e10827debff94eaace6477113d2b7c4da5cd},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38028. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Autonomous vehicles interacting with passengers through natural language must reason beyond immediate commands. Passenger intent may span multiple stages of behavior, depend on future events, refer to surrounding agents or landmarks, and remain relevant as driving conditions evolve. Existing language-enabled driving datasets largely focus on short, localized interactions, leaving these longer-horizon forms of passenger intent comparatively underexplored. We introduce doPlan, to our knowledge the first publicly available, human-annotated real-world dataset designed to study passenger language as persistent task context. Built on nuPlan, doPlan contains 5,154 human-written passenger instructions spanning 169.1 hours of cumulative instruction-aligned context over 50.9 hours of unique driving, with annotation windows ranging from 30.0 to 508.8 s. The annotations capture immediate, deferred, event-conditioned, persistent, and multi-stage passenger intent. The dataset, annotation interface, and supporting resources are publicly available at this https URL . We evaluate four language-conditioned driving models and find that sensitivity to passenger language does not reliably translate into behavior consistent with the requested direction. More broadly, among 2,161 examples with a matched future maneuver, the first associated maneuver occurs a median of 24.6 s after the evaluation point, and only 9.8% occur within the models' common 5 s prediction horizon. These findings highlight the need to connect persistent passenger intent with successive planning decisions. doPlan provides a setting for studying how unresolved goals can be retained, grounded in evolving scenes, and tracked across multiple stages, including how a planner determines when a future goal becomes relevant to the current plan. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.AI). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.38028 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T15:54:54.064Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).