Metraipolis › archive › dc_a3d82d2effed
Grounded Human-Attributed Description and Activity Recognition in Videos — arXiv:2610.22295
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.22295
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T10:39:12.249Z
- SHA-256 of the archived text
b2eaa82de8e34e1088e9e6748b0df9e6dc8cc36f9b36c527f1bc60fd622eb926- Stable URL of this page
https://metraipolis.com/documento/dc_a3d82d2effed
How to cite
Grounded Human-Attributed Description and Activity Recognition in Videos — arXiv:2610.22295 — arXiv (en), https://arxiv.org/abs/2610.22295 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a3d82d2effed (Metraipolis archive dc_a3d82d2effed, sha256 b2eaa82de8e34e1088e9e6748b0df9e6dc8cc36f9b36c527f1bc60fd622eb926)
BibTeX
@misc{dca3d82d2effed,
title = {Grounded Human-Attributed Description and Activity Recognition in Videos — arXiv:2610.22295},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.22295},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a3d82d2effed; sha256 b2eaa82de8e34e1088e9e6748b0df9e6dc8cc36f9b36c527f1bc60fd622eb926},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.22295. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding characteristics and activities of individuals in complex multi-person environments is crucial for real-world applications. However, existing datasets often simplify this problem to grounded group activity recognition, single-person activity recognition, or close-set activity recognition, thus limiting the generalizability of models trained on these datasets. In this work, we introduce the task of Grounded Human-Attributed Description and Activity Recognition (GHADAR), which involves describing the characteristics and activity descriptions of \textbf{every} person in a video, provided the location of the person in the video, which is more practical for real-world applications. To facilitate this, we introduce a new dataset derived from AVA-Actions by generating open-set captions for the person description and activity. In addition, we propose a novel method to effectively utilize the information contained in grounding during training by constraining the cross-attention masks during training in VLMs to improve performance for this task. Our experiments show that our method outperforms SOTA VLMs on this task. Finally, we demonstrate the limitations of existing evaluation metrics, which are overly reliant on human-annotations and exact text-text matching. As an added video-based evaluation, we propose a holistic VLM-based evaluation schema that compares concepts {\em directly} between the video and the generated predictions. Thus, in this work, we develop a complete framework for GHADAR, including a dataset, a novel method and an evaluation schema, thereby establishing a strong foundation for future research in this domain.
Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2610.22295 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T08:52:02.735Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).