Metraipolis › archive › dc_f4c81ed31e97
From Clips to Streams: A Unified Framework for Streaming Sign Language Translation — arXiv:2611.00055
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.00055
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T11:40:19.259Z
- SHA-256 of the archived text
6af99cfd4863f0ece52ac418bb7deb8a05d2a36470232ddd018cf448c819961e- Stable URL of this page
https://metraipolis.com/documento/dc_f4c81ed31e97
How to cite
From Clips to Streams: A Unified Framework for Streaming Sign Language Translation — arXiv:2611.00055 — arXiv (en), https://arxiv.org/abs/2611.00055 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f4c81ed31e97 (Metraipolis archive dc_f4c81ed31e97, sha256 6af99cfd4863f0ece52ac418bb7deb8a05d2a36470232ddd018cf448c819961e)
BibTeX
@misc{dcf4c81ed31e97,
title = {From Clips to Streams: A Unified Framework for Streaming Sign Language Translation — arXiv:2611.00055},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.00055},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f4c81ed31e97; sha256 6af99cfd4863f0ece52ac418bb7deb8a05d2a36470232ddd018cf448c819961e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00055. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Sign Language Translation (SLT) research has typically focused on pre-segmented clips, a constraint that disconnects models from the continuous reality of real-world communication. To bridge the gap from clips to streams, we formally define Streaming SLT, a realistic task demanding the joint discovery and translation of linguistic events from continuous, untrimmed video inputs. To address this challenge, we propose StreamSLST, the first end-to-end framework for Streaming Sign Language Segmentation and Translation via Deformable Transformer architecture. Unlike cascaded approaches that suffer from error propagation, StreamSLST employs a parallel decoding strategy to jointly optimize temporal segmentation and translation in a single pass. To enable scalable training on long-form videos, we incorporate a Sentence-aware Sliding Window Sampler that crops continuous streams into trainable units. We further design a Tri-modal Visual-Language Pretraining stage that aligns pose dynamics with textual semantics before joint optimization. To support comprehensive evaluation, we conduct experiments on two real-world streaming datasets, BOBSL and How2Sign, together with two newly constructed synthetic streaming benchmarks, Streaming-Phoenix-2014T and Streaming-CSL-Daily. The results demonstrate that StreamSLST consistently outperforms a matched cascaded segmentation-then-translation pipeline. Interestingly, our analysis reveals that joint optimization learns wider, translation-effective temporal support that simple expansion or rescaling of the annotated spans fails to reproduce. Our work establishes the first robust benchmark for continuous sign language understanding and paves the way for accessible real-world communication interfaces. The source code and data are available at this https URL . Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2611.00055 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T11:06:37.370Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).