Metraipolis › archive › dc_2a7416bb4dee
MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.15437
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T19:02:12.297Z
- SHA-256 of the archived text
d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e- Stable URL of this page
https://metraipolis.com/documento/dc_2a7416bb4dee
How to cite
MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437 — arXiv (en), https://arxiv.org/abs/2608.15437 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2a7416bb4dee (Metraipolis archive dc_2a7416bb4dee, sha256 d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e)
BibTeX
@misc{dc2a7416bb4dee,
title = {MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.15437},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2a7416bb4dee; sha256 d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.15437. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Multimodal bird's-eye-view (BEV) perception combines LiDAR depth accuracy with dense camera semantics, but its high computational cost and imperfect sensing conditions make real-time deployment challenging. Existing methods largely compress individual detectors and overlook three opportunities: structured sparsity within camera and LiDAR inputs, timing misalignment between modalities, and the fact that many detected objects do not affect the planner's immediate action. We present MM-BEV, a real-time multimodal BEV system guided by a simple principle: compute where and when it matters. MM-BEV divides perception into mandatory work for safety-critical objects within braking distance of the ego vehicle and with short time-to-collision (TTC), and optional work for less urgent regions. It prioritizes mandatory work and reduces or sheds optional work under tight compute budgets. MM-BEV integrates four mechanisms: (1) a criticality-ranked temporal ROI selector based on motion-extrapolated detections from prior frames; (2) sparse, ROI-aware feature extraction using shared-shape camera crops at context-adaptive resolution and ROI-aware LiDAR voxelization; (3) a latency-aware coordinator that adapts LiDAR sweeps, image resolution, and keyframes according to scene dynamics and TTC; and (4) an asynchronous scheduler that decouples sensing from inference and skips stale frames. On nuScenes, MM-BEV reduces inference latency by 1.96x and end-to-end latency by 2.93x, with no loss in geometry-critical recall and only a 0.2 percentage-point drop in safety-critical recall. On a Clearpath Husky A300 equipped with an Ouster-128 LiDAR, BEV cameras, and a Jetson AGX Orin, MM-BEV further reduces mean latency by 2.11x, demonstrating its potential for real-world autonomous systems. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-18 in cs.DC). Categorie arXiv: Robotics (cs.RO) ; Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY). Pagina del lavoro: https://arxiv.org/abs/2608.15437 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T18:07:16.087Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).