Metraipolis › archive › dc_ba9be6d96b33

RegulAR: Graph-Grounded Error Recognition and Assistance for Procedural Tasks in AR — arXiv:2608.26715

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.26715
License (as archived)
CC0-1.0
Archived
2026-10-17T16:04:58.459Z
SHA-256 of the archived text
2a67e4d27020e6b926b8838bded54f208ead90e9a097041e2d261afe95a95699
Stable URL of this page
https://metraipolis.com/documento/dc_ba9be6d96b33

How to cite

RegulAR: Graph-Grounded Error Recognition and Assistance for Procedural Tasks in AR — arXiv:2608.26715 — arXiv (en), https://arxiv.org/abs/2608.26715 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ba9be6d96b33 (Metraipolis archive dc_ba9be6d96b33, sha256 2a67e4d27020e6b926b8838bded54f208ead90e9a097041e2d261afe95a95699)
BibTeX
@misc{dcba9be6d96b33,
  title = {RegulAR: Graph-Grounded Error Recognition and Assistance for Procedural Tasks in AR — arXiv:2608.26715},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.26715},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ba9be6d96b33; sha256 2a67e4d27020e6b926b8838bded54f208ead90e9a097041e2d261afe95a95699},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.26715. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Errors are inevitable in procedural tasks, yet most AR guidance systems focus on step-by-step instruction delivery rather than helping users recognize and recover from mistakes. We present RegulAR, an AR task assistant for procedural error recognition and recovery. RegulAR models task instructions as a hierarchical dependency graph and combines this structure with a Multimodal Large Language Model (MLLM) to interpret egocentric observations during execution. This enables RegulAR to track progress, identify deviations by error type, estimate their impact on later steps, and deliver appropriately salient interventions through an in-situ head-up display that visualizes task state and recovery guidance. By making procedural structure explicit, RegulAR supports not only next-step guidance, but also reasoning about what went wrong, why it matters, and how users can get back on track. In a within-subject study (N=12), participants reported better task-structure understanding and recovery support with RegulAR than the MLLM-only baseline.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.HC).
Categorie arXiv: Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2608.26715 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T15:31:59.880Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).