Metraipolis › archive › dc_187dd248a9ec
R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video — arXiv:2608.11017
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.11017
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:09:37.325Z
- SHA-256 of the archived text
a2e82f441deb4a472370350bceb923c8a90903d305df4c1ae568b295b04c3721- Stable URL of this page
https://metraipolis.com/documento/dc_187dd248a9ec
How to cite
R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video — arXiv:2608.11017 — arXiv (en), https://arxiv.org/abs/2608.11017 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_187dd248a9ec (Metraipolis archive dc_187dd248a9ec, sha256 a2e82f441deb4a472370350bceb923c8a90903d305df4c1ae568b295b04c3721)
BibTeX
@misc{dc187dd248a9ec,
title = {R4DSG: Relative 4D Scene Graph Memory for Object-Centric Question Answering in Long Egocentric Video — arXiv:2608.11017},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.11017},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_187dd248a9ec; sha256 a2e82f441deb4a472370350bceb923c8a90903d305df4c1ae568b295b04c3721},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.11017. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Long-horizon egocentric video is a rich substrate for wearable AI assistants, but object-centric questions such as where an item was moved, when it last changed state, or why it was relocated remain difficult because caption- and transcript-based memories rarely preserve persistent object identity or structured spatial change. Existing long-video QA methods mainly emphasize temporal grounding and clip retrieval, while prior 3D scene-graph methods typically assume stronger geometry than free-motion wearable RGB video provides, including point clouds, RGB-D input, posed views, sparse reconstruction, or reconstructed scenes. R4DSG introduces a relative 4D scene graph memory for long egocentric video. Instead of storing raw graph sequences, R4DSG converts video into compact queryable memory entries indexed by time, place, persistent objects, anchor-relative change, and local interaction context. The main idea is to separate stable anchors from dynamic objects, maintain persistent object identity across frames, and represent object state through anchor-relative transitions rather than a globally aligned world model. Built on recent RGB-only advances in promptable video segmentation, temporal propagation, and relative 3D lifting, the method produces a retrieval-ready memory directly usable for long-horizon question answering. Evaluation on a 255-question object-related subset from EgoLifeQA shows, under question-only retrieval, a 6.7-point overall gain over EgoRAG-Text and a 12.5-point gain on when questions, which highlights the value of temporally organized object memory. These results position relative 4D scene graphs as a practical memory substrate for wearable assistants, AR systems, and embodied multimedia agents. GitHub Page: this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-12 in cs.AI). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Multimedia (cs.MM). Pagina del lavoro: https://arxiv.org/abs/2608.11017 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T05:57:28.424Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).