Metraipolis › archive › dc_fdec618c57cb

DTP-OPSD: Reinforcement Learning with Distractor-Aware Temporal-Privilege On-Policy Self-Distillation for Temporal Video Grounding — arXiv:2611.00120

Source: arXiv (en)
Original: https://arxiv.org/abs/2611.00120
License (as archived): CC0-1.0
Archived: 2026-11-03T10:34:01.759Z
SHA-256 of the archived text: 3e920478dd6e6d9f114f29be9d20c287e684d63fabd6026b897f3c79c442af91
Stable URL of this page: https://metraipolis.com/documento/dc_fdec618c57cb

How to cite

DTP-OPSD: Reinforcement Learning with Distractor-Aware Temporal-Privilege On-Policy Self-Distillation for Temporal Video Grounding — arXiv:2611.00120 — arXiv (en), https://arxiv.org/abs/2611.00120 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fdec618c57cb (Metraipolis archive dc_fdec618c57cb, sha256 3e920478dd6e6d9f114f29be9d20c287e684d63fabd6026b897f3c79c442af91)

BibTeX

@misc{dcfdec618c57cb,
  title = {DTP-OPSD: Reinforcement Learning with Distractor-Aware Temporal-Privilege On-Policy Self-Distillation for Temporal Video Grounding — arXiv:2611.00120},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00120},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fdec618c57cb; sha256 3e920478dd6e6d9f114f29be9d20c287e684d63fabd6026b897f3c79c442af91},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00120. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Temporal Video Grounding (TVG) aims to localize the start and end times of an event described by a language query in a video. The task becomes particularly challenging when the same video contains multiple repeated, similar, or opposite events. On these hard examples, all responses sampled by Group Relative Policy Optimization (GRPO) may miss the target and receive zero temporal Intersection-over-Union (tIoU). Their group-relative advantages are then all zero, leaving no useful policy gradient signal. To address this, we propose DTP-OPSD, a reinforcement learning framework with distractor-aware temporal-privilege on-policy self-distillation. The student observes the clean video and generates responses on-policy, while a shared-weight teacher observes a privileged video in which the target window is marked by red full-frame borders and same-video distractor windows by blue full-frame borders. For the distillation loss, the teacher evaluates student-generated prefixes and provides dense token-level Jensen-Shannon divergence supervision. This supervision remains informative even when GRPO provides no policy gradient signal. We suppress distillation when the teacher does not outperform the student and strengthen it for groups where the teacher performs better but all student rollouts receive zero tIoU. We also construct a compact hard-interference training set through VLM screening and human verification. With only 300 additional post-training examples, DTP-OPSD achieves the highest mIoU among the compared open-source 8B models on Charades-TimeLens, ActivityNet-TimeLens, and QVHighlights-TimeLens, reaching 55.93, 54.77, and 66.71, respectively. Compared with Pure GRPO trained on the same data, DTP-OPSD improves all 12 reported metrics, with [email protected] gains of 1.28, 1.62, and 1.78 points on the three benchmarks. Code will be released at this https URL

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.00120 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T10:29:48.670Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).