Metraipolis › archive › dc_e5bf50818b5a

S4VY: Segment Anything in Feed-Forward 4D Visual Geometry — arXiv:2609.36875

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.36875
License (as archived)
CC0-1.0
Archived
2026-10-07T18:38:36.514Z
SHA-256 of the archived text
3ce772bf38a2c02927b5d98b42df9f0fe726db24e90d1d00a2da123a9c7b0123
Stable URL of this page
https://metraipolis.com/documento/dc_e5bf50818b5a

How to cite

S4VY: Segment Anything in Feed-Forward 4D Visual Geometry — arXiv:2609.36875 — arXiv (en), https://arxiv.org/abs/2609.36875 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e5bf50818b5a (Metraipolis archive dc_e5bf50818b5a, sha256 3ce772bf38a2c02927b5d98b42df9f0fe726db24e90d1d00a2da123a9c7b0123)
BibTeX
@misc{dce5bf50818b5a,
  title = {S4VY: Segment Anything in Feed-Forward 4D Visual Geometry — arXiv:2609.36875},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.36875},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e5bf50818b5a; sha256 3ce772bf38a2c02927b5d98b42df9f0fe726db24e90d1d00a2da123a9c7b0123},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.36875. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Accurate instance segmentation in dynamic scenes is important for downstream applications such as robotics and autonomous driving. Existing Segment Anything models operate primarily on 2D image or video masks and preserve identity through sequential memory, while promptable 4D instance segmentation built upon feed-forward visual geometry remains underexplored. We introduce S4VY, a Segment Anything model built on feed-forward 4D visual geometry. From a set of RGB observations, S4VY transforms shared visual-geometric features into an exhaustive set of class-agnostic 4D instance masks through a space-time query decoder, with each persistent object query binding one entity across all observations. This representation supports prompt-independent segmentation as well as point- and box- conditioned selection, without requiring a seed mask or temporal ordering. We further develop an agentic harness for natural-language grounding in the large observation space of a 4D scene. Active tree search identifies relevant frames without scanning every fixed window; a dual-stream grounder combines fine-grained VLM visual priors with geometry-consistent instance features through complementary bounding-box prediction and object-query matching; and an independent critic selects the final 4D instance mask from their predictions. Extensive experiments demonstrate state-of-the-art 4D instance segmentation and strong language-guided grounding performance under a unified evaluation spanning static and dynamic scenes.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.36875 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T18:04:24.769Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).