Metraipolis › archive › dc_79067280792e

EgoAfford: Task-Oriented Affordance Grounding via Egocentric Referring Segmentation — arXiv:2608.04533

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.04533
License (as archived)
CC0-1.0
Archived
2026-10-31T11:47:57.348Z
SHA-256 of the archived text
2d5dbc2bcdcf90843a04660152483c5a20b239d16547182359c95ac5cde81234
Stable URL of this page
https://metraipolis.com/documento/dc_79067280792e

How to cite

EgoAfford: Task-Oriented Affordance Grounding via Egocentric Referring Segmentation — arXiv:2608.04533 — arXiv (en), https://arxiv.org/abs/2608.04533 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_79067280792e (Metraipolis archive dc_79067280792e, sha256 2d5dbc2bcdcf90843a04660152483c5a20b239d16547182359c95ac5cde81234)
BibTeX
@misc{dc79067280792e,
  title = {EgoAfford: Task-Oriented Affordance Grounding via Egocentric Referring Segmentation — arXiv:2608.04533},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.04533},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_79067280792e; sha256 2d5dbc2bcdcf90843a04660152483c5a20b239d16547182359c95ac5cde81234},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.04533. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Part-level affordance grounding has advanced the localization of functional object regions associated with elemental actions. Extending this capability to complex tasks calls for connecting the semantic roles of participating objects with task-state-aligned visual observations and multi-step planning. We introduce EgoAfford, a benchmark designed to connect these three aspects. Given an egocentric observation and a high-level tabletop task, a model must generate the remaining plan and segment the functional regions of up to three components of the next action: the direct object, instrument, and destination. EgoAfford comprises approximately 15.5k human-verified images from 2,000 generated multi-step scenes, organized as semantically aligned, task-complete image series, together with EgoAfford-Real, 102 manually captured images spanning 26 tasks. We further present EgoLens, a 3B multimodal large language model with role-specific mask decoders, as an in-domain reference model for this joint task. Evaluations of recent referring-segmentation MLLMs, commercial-VLM--SAM2 pipelines, and EgoLens highlight the complementary challenges of next-step inference and action-role-conditioned part grounding. EgoLens establishes strong reference performance on both generated and manually captured observations. Together, EgoAfford and EgoLens provide a foundation for jointly studying perception and planning in multi-step tabletop tasks. Our project page is available at: this https URL

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-06 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2608.04533 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T11:37:40.680Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-08-06?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).