Metraipolis › archive › dc_d0528004efed
SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streaming — arXiv:2609.18075
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.18075
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T15:39:00.467Z
- SHA-256 of the archived text
73c34506bafbab9c1122423f7e477444b54cb2451b1973486329bf79974f5575- Stable URL of this page
https://metraipolis.com/documento/dc_d0528004efed
How to cite
SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streaming — arXiv:2609.18075 — arXiv (en), https://arxiv.org/abs/2609.18075 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d0528004efed (Metraipolis archive dc_d0528004efed, sha256 73c34506bafbab9c1122423f7e477444b54cb2451b1973486329bf79974f5575)
BibTeX
@misc{dcd0528004efed,
title = {SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streaming — arXiv:2609.18075},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.18075},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d0528004efed; sha256 73c34506bafbab9c1122423f7e477444b54cb2451b1973486329bf79974f5575},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.18075. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Conventional video metrics such as PSNR, SSIM, and VMAF measure visual distortion or perceptual quality, but they do not directly capture semantic preservation: whether compression retains a video's objects, actions, and temporal narrative. Existing Quality-of-Experience (QoE)-driven bitrate-selection and resource-allocation methods primarily aim to minimize rebuffering and bitrate switching while maximizing perceptual video quality, without explicitly considering semantic preservation. To address this gap, we introduce video semantic fidelity (SF), a metric that quantifies how well a compressed video preserves the semantic content of its source. An offline multimodal large language model (MLLM) generates structured descriptions of the reference and compressed versions of the video, and a separate text-only large language model (LLM) evaluates their semantic correspondence. The resulting content-dependent SF--bitrate profiles are cached and queried by the online bitrate selector without invoking MLLMs at runtime. Evaluations on three subjective QoE benchmarks show a consistent positive association between SF and mean opinion scores (MOS). A separate human semantic-rating study evaluates semantic preservation and shows that SF correlates more strongly with human judgments than conventional video metrics. We then embed these profiles into a 5G MEC-assisted video-on-demand (VoD) resource-allocation framework at the base station. When wireless resources cannot support high bitrate levels for all users, the framework uses the SF--bitrate profiles to select bitrate levels jointly across users and reduce the semantic loss caused by the required bitrate reductions. NS-3 simulations with the 5G NR module show that the proposed framework achieves higher average and worst-user SF than the evaluated baselines, with a widening advantage as the wireless resources available to each user decrease. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-17 in cs.NI). Categorie arXiv: Multimedia (cs.MM) ; Networking and Internet Architecture (cs.NI). Pagina del lavoro: https://arxiv.org/abs/2609.18075 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T15:04:48.408Z dalla pagina https://arxiv.org/catchup/cs.NI/2026-09-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).