Metraipolis › archive › dc_260ead700425

WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark — arXiv:2611.05801

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.05801
License (as archived)
CC0-1.0
Archived
2026-11-05T18:22:36.049Z
SHA-256 of the archived text
963bb821d636e8889a1857a45e8745d182a4eb5e427c2b5511f561f58ec487cc
Stable URL of this page
https://metraipolis.com/documento/dc_260ead700425

How to cite

WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark — arXiv:2611.05801 — arXiv (en), https://arxiv.org/abs/2611.05801 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_260ead700425 (Metraipolis archive dc_260ead700425, sha256 963bb821d636e8889a1857a45e8745d182a4eb5e427c2b5511f561f58ec487cc)
BibTeX
@misc{dc260ead700425,
  title = {WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark — arXiv:2611.05801},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.05801},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_260ead700425; sha256 963bb821d636e8889a1857a45e8745d182a4eb5e427c2b5511f561f58ec487cc},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.05801. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Holistic perception for autonomous agents requires reliably segmenting and associating scene elements across time and camera views, including objects outside a fixed semantic taxonomy. Existing open-set panoptic benchmarks focus on individual images or views, while panoramic tracking benchmarks assume closed-set taxonomies. Consequently, these benchmarks do not evaluate whether unknown objects can be consistently segmented and tracked across synchronized multi-camera sequences. We introduce WayPOP, a panoramic open-set panoptic tracking benchmark built on real Waymo PVPS sequences augmented with diverse out-of-taxonomy 3D assets from Objaverse. Inserted objects are placed at fixed locations in the 3D scene and rendered using calibrated vehicle-mounted cameras as the ego vehicle and surrounding traffic move, providing temporally and cross-view consistent panoptic annotations and auxiliary LiDAR range observations. WayPOP contains approximately 670 curated assets instantiated as 980 unique unknown-object tracks, yielding 53,452 unknown-object mask annotations across 21,300 camera images. Our evaluation protocol defines a hierarchy of tasks from view-independent open-set panoptic segmentation to full panoramic open-set panoptic tracking, using known/unknown PQ and (w)STQ metrics. We benchmark representative open-set and open-vocabulary segmentation methods with temporal and cross-camera association. Our results reveal substantial limitations of current methods in truly open-set scenarios, highlighting robust unknown-object localization and identity association across time and views as major open challenges.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Machine Learning (cs.LG); Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2611.05801 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-05T18:15:49.034Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).