Metraipolis › archive › dc_fe368a20d56c
MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving — arXiv:2609.20747
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.20747
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-10T04:09:30.014Z
- SHA-256 of the archived text
9823d0c7cd81c8fd91ad49c189cb0bea3f31db774dcad98b32289f84fa8fb58d- Stable URL of this page
https://metraipolis.com/documento/dc_fe368a20d56c
How to cite
MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving — arXiv:2609.20747 — arXiv (en), https://arxiv.org/abs/2609.20747 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fe368a20d56c (Metraipolis archive dc_fe368a20d56c, sha256 9823d0c7cd81c8fd91ad49c189cb0bea3f31db774dcad98b32289f84fa8fb58d)
BibTeX
@misc{dcfe368a20d56c,
title = {MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving — arXiv:2609.20747},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.20747},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fe368a20d56c; sha256 9823d0c7cd81c8fd91ad49c189cb0bea3f31db774dcad98b32289f84fa8fb58d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.20747. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Reinforcement learning constitutes a promising approach owing to its potential for superhuman performance and self-learned policies. However, its application to real-world autonomous driving remains scarce, particularly in unstructured environments, because of the challenges associated with sim-to-real transfer for unstructured environments. In this work, we present MILER, an end-to-end policy framework with zero-shot sim-to-real transfer. During offline training, we employ a custom semantic mid-level representation (MLR) simulator and train the policy network using reinforcement learning, with its control outputs applied directly to a bicycle model. During deployment on the real vehicle, camera and LiDAR data are processed by BEVFusion to generate a semantic bird's-eye-view representation consistent with that of the MLR simulator. The actions generated by the policy network are not applied directly to the real vehicle. Instead, we employ a trajectory-alignment strategy that enables zero-shot sim-to-real transfer of both perception and control. We extensively evaluate the proposed framework on a diverse test track comprising numerous challenges, including various obstacles, hairpin curves, velocities of up to 33.6 km/h, and off-road sections. In total, we drove 17.3 km with two different vehicles on a 3.0 km test track without human intervention, thereby demonstrating the effectiveness of our approach. Furthermore, the entire software stack runs on a Jetson AGX Orin. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.LG). Categorie arXiv: Robotics (cs.RO) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.20747 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-10T03:48:18.476Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).