Metraipolis › archive › dc_caa76e4dab48

Through Human Eyes and Machine Eyes: Understanding View Mismatch in Video See-Through Extended Reality — arXiv:2609.29173

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29173
License (as archived)
CC0-1.0
Archived
2026-10-08T04:53:28.052Z
SHA-256 of the archived text
7b8867921b57454a0096ae87c865f7bc4802d249f9e41671364ca44b9441a262
Stable URL of this page
https://metraipolis.com/documento/dc_caa76e4dab48

How to cite

Through Human Eyes and Machine Eyes: Understanding View Mismatch in Video See-Through Extended Reality — arXiv:2609.29173 — arXiv (en), https://arxiv.org/abs/2609.29173 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_caa76e4dab48 (Metraipolis archive dc_caa76e4dab48, sha256 7b8867921b57454a0096ae87c865f7bc4802d249f9e41671364ca44b9441a262)
BibTeX
@misc{dccaa76e4dab48,
  title = {Through Human Eyes and Machine Eyes: Understanding View Mismatch in Video See-Through Extended Reality — arXiv:2609.29173},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29173},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_caa76e4dab48; sha256 7b8867921b57454a0096ae87c865f7bc4802d249f9e41671364ca44b9441a262},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29173. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Video see-through extended reality (VST XR) systems commonly use headset screenshots or captured frames as proxies for the user's first-person visual context. However, the system-captured view and the user's effective visible field do not necessarily coincide: a screenshot records a rectangular machine-readable frame, whereas the user's effective visible region can be more constrained and non-rectangular. This paper studies this human-system view mismatch in VST XR. We formalize the relationship between the system-captured region and the human-visible region by defining their co-visible, system-only, and human-only regions. \rev{We then conduct a pilot-level boundary measurement on Meta Quest 3, revealing a clear mismatch between the rectangular screenshot frame and the approximate human-visible boundary. Building on this model, we analyze how view mismatch can affect screenshot-based XR sensing and downstream vision-language model tasks. Through four representative case studies, we illustrate potential risks and failure modes including prompt injection, privacy leakage, human-invisible information bias, and missing human-visible information. Our results show that view mismatch is not only a geometric artifact, but can also introduce security, privacy, and reliability concerns for AI-integrated VST XR systems.

Tema degli esploratori: fiducia digitale e crittografia (retro-catalogo arXiv: annunci del 2026-09-25 in cs.CR).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Cryptography and Security (cs.CR).
Pagina del lavoro: https://arxiv.org/abs/2609.29173 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T04:30:43.850Z dalla pagina https://arxiv.org/catchup/cs.CR/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).