Metraipolis › archive › dc_2a7416bb4dee

MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.15437
License (as archived)
CC0-1.0
Archived
2026-10-18T19:02:12.297Z
SHA-256 of the archived text
d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e
Stable URL of this page
https://metraipolis.com/documento/dc_2a7416bb4dee

How to cite

MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437 — arXiv (en), https://arxiv.org/abs/2608.15437 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2a7416bb4dee (Metraipolis archive dc_2a7416bb4dee, sha256 d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e)
BibTeX
@misc{dc2a7416bb4dee,
  title = {MM-BEV: Enhancing Timeliness by Computing Where and When it Matters — arXiv:2608.15437},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.15437},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2a7416bb4dee; sha256 d585f73a7b8028d4c3dabc7bd0cb6eac7b5454c19fd5b06ad81232e98d387c1e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.15437. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal bird's-eye-view (BEV) perception combines LiDAR depth accuracy with dense camera semantics, but its high computational cost and imperfect sensing conditions make real-time deployment challenging. Existing methods largely compress individual detectors and overlook three opportunities: structured sparsity within camera and LiDAR inputs, timing misalignment between modalities, and the fact that many detected objects do not affect the planner's immediate action. We present MM-BEV, a real-time multimodal BEV system guided by a simple principle: compute where and when it matters. MM-BEV divides perception into mandatory work for safety-critical objects within braking distance of the ego vehicle and with short time-to-collision (TTC), and optional work for less urgent regions. It prioritizes mandatory work and reduces or sheds optional work under tight compute budgets. MM-BEV integrates four mechanisms: (1) a criticality-ranked temporal ROI selector based on motion-extrapolated detections from prior frames; (2) sparse, ROI-aware feature extraction using shared-shape camera crops at context-adaptive resolution and ROI-aware LiDAR voxelization; (3) a latency-aware coordinator that adapts LiDAR sweeps, image resolution, and keyframes according to scene dynamics and TTC; and (4) an asynchronous scheduler that decouples sensing from inference and skips stale frames. On nuScenes, MM-BEV reduces inference latency by 1.96x and end-to-end latency by 2.93x, with no loss in geometry-critical recall and only a 0.2 percentage-point drop in safety-critical recall. On a Clearpath Husky A300 equipped with an Ouster-128 LiDAR, BEV cameras, and a Jetson AGX Orin, MM-BEV further reduces mean latency by 2.11x, demonstrating its potential for real-world autonomous systems.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-18 in cs.DC).
Categorie arXiv: Robotics (cs.RO) ; Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY).
Pagina del lavoro: https://arxiv.org/abs/2608.15437 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T18:07:16.087Z dalla pagina https://arxiv.org/catchup/cs.DC/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).