Metraipolis › archive › dc_42aeffc44e9b
From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation — arXiv:2609.19413
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.19413
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-10T03:23:03.142Z
- SHA-256 of the archived text
f15cacf2ddeb4cc905eaf4f52ad32241136ef967d3854c779a8261a101a8c2c8- Stable URL of this page
https://metraipolis.com/documento/dc_42aeffc44e9b
How to cite
From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation — arXiv:2609.19413 — arXiv (en), https://arxiv.org/abs/2609.19413 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_42aeffc44e9b (Metraipolis archive dc_42aeffc44e9b, sha256 f15cacf2ddeb4cc905eaf4f52ad32241136ef967d3854c779a8261a101a8c2c8)
BibTeX
@misc{dc42aeffc44e9b,
title = {From Rollout to Reset: A Graph-Based Harness for Autonomous Long-Horizon Manipulation Evaluation — arXiv:2609.19413},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.19413},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_42aeffc44e9b; sha256 f15cacf2ddeb4cc905eaf4f52ad32241136ef967d3854c779a8261a101a8c2c8},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.19413. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Robot manipulation policies are improving quickly, and real-robot evaluation remains the standard evidence for that progress. It still relies on a human to reset the scene between rollouts, which consumes operator time and leaves the initial state distribution unspecified, so results reproduce poorly. A recent system, AutoEval, automates both reset and scoring, but only for single-step tasks, because a long-horizon rollout can terminate in combinatorially many configurations that no single learned reset policy covers. We present HALTER, a Harness for Autonomous Long-horizon Task Evaluation and Reset, which restores the scene by planning over a library of learned atomic reset skills, so demonstration cost scales with the size of that library rather than with the number of terminal states. HALTER builds a spatial scene graph online from point clouds and vision foundation models, and an LLM reasons over this graph to score the rollout, plan the reset, and verify that the reset succeeded, without collecting labeled success images for any task. On four long-horizon tasks on a Franka arm, HALTER restores the scene in 76% of episodes, against 52% for AutoEval and 65% for a motion-planning reset, and it estimates the completed-skill fraction correctly in 90% of episodes, against 76%. Its reset-verification verdict is correct in 91% of episodes, compared with 78% for AutoEval. It also cuts the operator time of an evaluation campaign by 72% relative to manual reset. We further measure compositional generalization on three held-out tasks, where HALTER resets 74.7% of episodes against 1.3% for a per-task reset policy, and we ablate the scene representation and the graph update rate. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.AI). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.19413 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-10T03:04:13.809Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).