Metraipolis › archive › dc_adeee2401bab

THG-Omni: Traceable Human-Centric Graph Supervision for Video Reasoning — arXiv:2611.07836

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.07836
License (as archived)
CC0-1.0
Archived
2026-11-06T14:42:41.117Z
SHA-256 of the archived text
34dc3cc6e5bbc91e49262f697405e3d6ae2fe9480be70752cc18afcd4f30baa3
Stable URL of this page
https://metraipolis.com/documento/dc_adeee2401bab

How to cite

THG-Omni: Traceable Human-Centric Graph Supervision for Video Reasoning — arXiv:2611.07836 — arXiv (en), https://arxiv.org/abs/2611.07836 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_adeee2401bab (Metraipolis archive dc_adeee2401bab, sha256 34dc3cc6e5bbc91e49262f697405e3d6ae2fe9480be70752cc18afcd4f30baa3)
BibTeX
@misc{dcadeee2401bab,
  title = {THG-Omni: Traceable Human-Centric Graph Supervision for Video Reasoning — arXiv:2611.07836},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.07836},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_adeee2401bab; sha256 34dc3cc6e5bbc91e49262f697405e3d6ae2fe9480be70752cc18afcd4f30baa3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07836. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Omni-modal models can answer questions about video, but their predictions rarely show which participant, event, or interval supports an answer. Moreover, answer-level supervision alone does not teach a model to interpret structured video evidence. To systematically mitigate this issue, we present THG-Omni, a human-centric graph-supervision framework that links Segment Anything Model~3 participant tracks with temporally grounded Qwen3-VL annotations. Candidate semantic claims are checked against the source video and available audio before they are used to construct training questions, while track geometry provides explicit spatial and temporal supervision. The resulting questions teach an omni-modal reasoning model to interpret participant attributes, actions, affect, interactions, and their timing from a structured graph. At inference, THG-Omni uses a predicted graph constructed from the evaluation video. Experiments on IntentBench show consistent improvements over the unadapted backbone across social reasoning, emotion understanding, and deception perception. On NExT-QA, THG-Omni achieves 89.54\% accuracy with the matched graph, compared with 85.10\% without graph input. Further validation experiments show that compact graph input achieves 78.22\% accuracy, compared with 78.02\% using the full graph and 77.58\% without graph input. A complementary diagnostic demonstrates that the predicted graph preserves evidence useful for answering questions even without the source video and audio. Together, these findings show that THG-Omni improves human-centric video reasoning while grounding its evidence in identifiable participants and events. Our codes are available at this https URL

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.07836 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:18:42.690Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).