Metraipolis › archive › dc_156753fde1ea

Seeing Semantic Shift: Difference-Aware Sentence-Level Temporal Segmentation of Sign Language Videos — arXiv:2609.31148

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.31148
License (as archived)
CC0-1.0
Archived
2026-10-08T03:12:42.957Z
SHA-256 of the archived text
314ec19f23116a75c7a2a3524522a1f969634ede12416f0b113048d95eb15d9a
Stable URL of this page
https://metraipolis.com/documento/dc_156753fde1ea

How to cite

Seeing Semantic Shift: Difference-Aware Sentence-Level Temporal Segmentation of Sign Language Videos — arXiv:2609.31148 — arXiv (en), https://arxiv.org/abs/2609.31148 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_156753fde1ea (Metraipolis archive dc_156753fde1ea, sha256 314ec19f23116a75c7a2a3524522a1f969634ede12416f0b113048d95eb15d9a)
BibTeX
@misc{dc156753fde1ea,
  title = {Seeing Semantic Shift: Difference-Aware Sentence-Level Temporal Segmentation of Sign Language Videos — arXiv:2609.31148},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.31148},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_156753fde1ea; sha256 314ec19f23116a75c7a2a3524522a1f969634ede12416f0b113048d95eb15d9a},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.31148. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recent advances in sign language understanding have achieved impressive success on short, single-sentence videos, yet their performance drops sharply when applied to long, continuous sign language videos. To bridge this gap, we focus on a challenging and realistic setting: Visual-only Sentence-level Sign Language Segmentation (Vis-SSLS), which aims to partition continuous sign language videos into non-overlapping sentence-level segments without any caption assistance, serving as a crucial prerequisite for downstream recognition and translation tasks. However, sentence transitions in sign language are often smooth and visually ambiguous, lacking explicit pauses or posture resets. As a result, static frame representations may fail to capture the subtle temporal changes that indicate sentence boundaries. To address this challenge, we propose \textbf{SignShift}, a difference-aware segmentation framework that explicitly models frame-to-frame feature variation as semantic cues for sentence boundary detection. First, to model the feature variation, we design a Temporal Difference Module, which incorporates full-frame, facial, and hand cues, and employs inter-frame differencing to learn multi-scale temporal variations that capture both fine-grained local kinematics and global semantic transitions. Second, to mitigate over- and under-segmentation issues, we design a Segment Count Prediction module, which predicts the number of sentences to guide boundary selection. Extensive experiments on benchmark datasets demonstrate that SignShift substantially outperforms existing methods, validating its effectiveness.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-28 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.31148 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T02:50:19.082Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).