Metraipolis › archive › dc_1dff228352de

CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction — arXiv:2609.00242

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.00242
License (as archived)
CC0-1.0
Archived
2026-10-17T06:33:01.237Z
SHA-256 of the archived text
de925f65260e45340d482bac6f69423eca18815516d93ff08fdecd9a642a54f0
Stable URL of this page
https://metraipolis.com/documento/dc_1dff228352de

How to cite

CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction — arXiv:2609.00242 — arXiv (en), https://arxiv.org/abs/2609.00242 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_1dff228352de (Metraipolis archive dc_1dff228352de, sha256 de925f65260e45340d482bac6f69423eca18815516d93ff08fdecd9a642a54f0)
BibTeX
@misc{dc1dff228352de,
  title = {CoLT-Drive: Counterfactual Long-Tail Benchmarking and Knowledge-Preserving Adaptation for Driving Affordance Prediction — arXiv:2609.00242},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.00242},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_1dff228352de; sha256 de925f65260e45340d482bac6f69423eca18815516d93ff08fdecd9a642a54f0},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.00242. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Long-tail autonomous driving failures are often framed as rare-object recognition errors. We argue that this view is incomplete: the decision-critical question is not only whether a model recognizes an unusual object, but whether it infers how that object changes the ego vehicle's feasible high-level actions. We formalize this problem as decision-level driving affordance prediction, where a model maps a front-view image, ego-motion history, and navigation command to a structured longitudinal--lateral meta-action. To evaluate this capability, we introduce CoLT-Drive, a 3,536-sample counterfactual long-tail benchmark that inserts rare objects into otherwise fixed driving scenes and measures whether models predict acceptable action pairs. To improve deployable small VLMs, we propose KPA, a knowledge-preserving adaptation framework that combines structured perception-to-decision prompting, SLERP-based expert merging, and RegMoE, a regime-aware LoRA mixture-of-experts module. KPA preserves the pretrained model's open-world knowledge while allocating lightweight adaptation capacity to different driving decision regimes. Experiments on an in-domain driving split and CoLT-Drive show that KPA achieves 60.8\% pair accuracy on CoLT-Drive, outperforming the pretrained Qwen3-VL-2B baseline (50.3\%) and LoRA SFT (32.4\%) while maintaining competitive in-domain accuracy. Our benchmark and code are available at this https URL and this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.AI).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.00242 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T06:15:12.758Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).