Metraipolis › archive › dc_45ad9603faef
Robot-GST: geometry-aware spatial-temporal robot policy representation and evaluation — arXiv:2609.33872
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.33872
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T21:01:51.942Z
- SHA-256 of the archived text
29e8916e6d4c615e06ae38b1898f7582bd270765d9b6a18688d5d62369130df1- Stable URL of this page
https://metraipolis.com/documento/dc_45ad9603faef
How to cite
Robot-GST: geometry-aware spatial-temporal robot policy representation and evaluation — arXiv:2609.33872 — arXiv (en), https://arxiv.org/abs/2609.33872 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_45ad9603faef (Metraipolis archive dc_45ad9603faef, sha256 29e8916e6d4c615e06ae38b1898f7582bd270765d9b6a18688d5d62369130df1)
BibTeX
@misc{dc45ad9603faef,
title = {Robot-GST: geometry-aware spatial-temporal robot policy representation and evaluation — arXiv:2609.33872},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.33872},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_45ad9603faef; sha256 29e8916e6d4c615e06ae38b1898f7582bd270765d9b6a18688d5d62369130df1},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33872. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Robotic manipulation policies are advancing rapidly with increasing reliance on vision-language models for end-to-end decision making. However, reliable deployment remains challenging because many policies lack explicit mechanisms for predicting task outcomes and evaluating whether generated actions will achieve desired final states, causing execution errors to accumulate during long-horizon manipulation. We present Robot-GST, a geometry-aware spatio-temporal behaviour representation and evaluation framework that constructs a Gaussian-SAM robotic environment for real-to-sim policy verification and improves the reliability of real-world manipulation deployment. Our approach constructs a high-fidelity robotic environment from RGB-D observations using 3D Gaussian Splatting and SAM3D, enabling ``simulation and evaluation before acting''. It integrates visual observations and language instructions with spatio-temporal reasoning for long-horizon task planning using large vision-language models. To bridge high-level planning and real-world execution, we introduce Gaussian-aware final-state estimation through geometric sampling and state-based trajectory planning. Before execution, candidate action sequences are simulated and evaluated in the Gaussian-SAM environment to filter infeasible behaviours. We validate our approach on representative manipulation tasks involving rigid, soft, and deformable objects, including cube placing, toy packing, and duck rearrangement, demonstrating that geometry-aware spatio-temporal reasoning and state-aware execution improve manipulation reliability across different object categories. Our results suggest that combining geometry-aware reconstruction with high-quality rendering and simulation provides a scalable approach for evaluating robotic manipulation behaviours. Website: this https URL Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.33872 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:02.773Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).