Metraipolis › archive › dc_38d3185bb52c

Seeing What the Vehicle Sees: Video-Augmented Virtual Reality for Physical Autonomous Vehicles — arXiv:2609.13224

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.13224
License (as archived)
CC0-1.0
Archived
2026-10-16T02:09:21.385Z
SHA-256 of the archived text
2a3ec9f5be10dd4cb140ea45dc66ac7561ef250e192e117ef3b8390d8fb12cc2
Stable URL of this page
https://metraipolis.com/documento/dc_38d3185bb52c

How to cite

Seeing What the Vehicle Sees: Video-Augmented Virtual Reality for Physical Autonomous Vehicles — arXiv:2609.13224 — arXiv (en), https://arxiv.org/abs/2609.13224 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_38d3185bb52c (Metraipolis archive dc_38d3185bb52c, sha256 2a3ec9f5be10dd4cb140ea45dc66ac7561ef250e192e117ef3b8390d8fb12cc2)
BibTeX
@misc{dc38d3185bb52c,
  title = {Seeing What the Vehicle Sees: Video-Augmented Virtual Reality for Physical Autonomous Vehicles — arXiv:2609.13224},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.13224},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_38d3185bb52c; sha256 2a3ec9f5be10dd4cb140ea45dc66ac7561ef250e192e117ef3b8390d8fb12cc2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.13224. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Autonomous vehicles are expected to improve road safety and efficiency, but passengers often remain uncertain about what the vehicle perceives and why it acts as it does. Virtual reality (VR) offers a safe and repeatable medium for presenting this information, yet most passenger-facing VR studies rely on fully simulated vehicles or pre-scripted scenarios, so the motion and perception shown to the user do not originate from a physically operating autonomous system. This paper presents a video-augmented VR framework that couples a physical ROS 2 autonomous robot vehicle to a Unity 6 application deployed on a Meta Quest 3S headset. The vehicle state and live onboard camera stream are transmitted over two independent communication channels, allowing the virtual vehicle to mirror the physical robot's motion while the passenger simultaneously views the vehicle's first-person camera feed and its navigation decisions through an in-vehicle dashboard interface. We evaluate the framework over 20 repeated closed-loop navigation trials. The system achieves a mean state-update latency of 29.63 ms, a mean relative route-progress error of 2.28% between the physical and virtual vehicles, and video delivery at 10.006 frames per second with 0.25% frame loss. All monitored navigation decisions were correctly reflected in the VR interface with no missed or incorrect notifications. The results indicate that the framework can support temporally synchronized, semantically consistent, and accurate route-progress representation for immersive observation of physical autonomous-vehicle behavior.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-15 in cs.RO).
Categorie arXiv: Robotics (cs.RO) ; Systems and Control (eess.SY).
Pagina del lavoro: https://arxiv.org/abs/2609.13224 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T01:52:32.284Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).