Metraipolis › archive › dc_5ffbc92076f3

DYAD: A Multimodal Dataset of Co-Located Human Assistance — arXiv:2609.09023

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.09023
License (as archived)
CC0-1.0
Archived
2026-10-16T15:31:28.778Z
SHA-256 of the archived text
22b2990425aa889d3120aadc6e1bedc1ea3d795ed066540f90716ede9cc5135a
Stable URL of this page
https://metraipolis.com/documento/dc_5ffbc92076f3

How to cite

DYAD: A Multimodal Dataset of Co-Located Human Assistance — arXiv:2609.09023 — arXiv (en), https://arxiv.org/abs/2609.09023 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_5ffbc92076f3 (Metraipolis archive dc_5ffbc92076f3, sha256 22b2990425aa889d3120aadc6e1bedc1ea3d795ed066540f90716ede9cc5135a)
BibTeX
@misc{dc5ffbc92076f3,
  title = {DYAD: A Multimodal Dataset of Co-Located Human Assistance — arXiv:2609.09023},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.09023},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_5ffbc92076f3; sha256 22b2990425aa889d3120aadc6e1bedc1ea3d795ed066540f90716ede9cc5135a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.09023. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

An embodied assistant working beside a person must track task state, recognize help seeking, choose how to intervene, and produce an appropriate response. Existing procedural datasets richly describe individual execution, while interactive datasets capture remote verbal instruction or undifferentiated co-working. They do not jointly link a co-located helper's verbal and physical interventions to performer requests, task state, assistance triggers, and outcomes. We introduce DYAD (DYadic Assistance Dataset), a synchronized multimodal record of human-human assistance during gearbox assembly. Across 20 sessions, one trained helper follows a guidance-first policy while assisting HoloLens 2 wearers. DYAD links 528 task-step intervals and 611 performer requests with 851 valid assistance records spanning verbal and physical help. DYAD's annotations span the assistance process; three reference tasks evaluate selected components rather than an end-to-end system: causal step understanding, pre-onset mode anticipation, and instructor response generation. On 829 eligible mode events, the strongest four-seed RGB mean is 0.548 +/- 0.007 macro-F1; causal metadata reaches 0.624 and a privileged trigger mapping 0.915, revealing information not recovered from pre-onset RGB. DYAD's contribution is not scale, but a linked interaction structure spanning help seeking, intervention choice, execution, and outcome under egocentric and workspace sensing.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-09 in cs.RO).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.09023 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T15:11:47.660Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).