Metraipolis › archive › dc_1102c2a551ca

GraspTwin: Zero-Shot Task-Oriented Grasp Optimization via a Digital Twin — arXiv:2609.30543

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.30543
License (as archived)
CC0-1.0
Archived
2026-10-08T03:14:44.473Z
SHA-256 of the archived text
0a00a6eade5ae59fddc5650fd5615cf27c82dc5fe1c5c146b1675b2fd726413e
Stable URL of this page
https://metraipolis.com/documento/dc_1102c2a551ca

How to cite

GraspTwin: Zero-Shot Task-Oriented Grasp Optimization via a Digital Twin — arXiv:2609.30543 — arXiv (en), https://arxiv.org/abs/2609.30543 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_1102c2a551ca (Metraipolis archive dc_1102c2a551ca, sha256 0a00a6eade5ae59fddc5650fd5615cf27c82dc5fe1c5c146b1675b2fd726413e)
BibTeX
@misc{dc1102c2a551ca,
  title = {GraspTwin: Zero-Shot Task-Oriented Grasp Optimization via a Digital Twin — arXiv:2609.30543},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.30543},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_1102c2a551ca; sha256 0a00a6eade5ae59fddc5650fd5615cf27c82dc5fe1c5c146b1675b2fd726413e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.30543. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

As robots transition from structured factory settings into homes, they are required to interact with an ever-increasing variety of objects. Many tasks require grasping, and often it is not sufficient to just pick up the target object. Consider a task like "pouring coffee" --- to facilitate the subsequent pouring, the robot should grasp the mug by its handle. Existing learning-based approaches for grasping either find robust and collision-free grasps that are largely agnostic to the task (e.g., picking up the mug by its rim), or leverage foundation models to propose task-appropriate grasp locations that lack fine-grained physical grounding (e.g., reaching for and missing the handle). In this work, we bridge these approaches with a real-to-sim-to-real framework. Based on a single RGB-D observation, we construct a digital twin of the environment, query a large foundation model to propose grasps that align with the object's affordances and task description, and then optimize the proposals to ensure robustness and plausibility before executing the result on the real robot. Our key insight is that the grasp proposals of the foundation model should be regarded as semantic priors that serve as seeds for local, gradient-free optimization. We leverage Bayesian optimization with Thompson sampling to draw batches of nearby poses, which are subsequently evaluated in parallel under domain-randomized physics rollouts. The resulting grasp is both task-oriented and physically feasible for execution by the robot arm. Our full zero-shot real-world transfer only takes a few minutes and improves task-oriented grasping success by up to 33% as compared to other state-of-the-art pipelines. Our code is available here: this https URL

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-28 in cs.RO).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.30543 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T02:58:08.805Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).