Metraipolis › archive › dc_acada94cb14e
VLMs for Videogame Data Annotation — arXiv:2608.05949
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.05949
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-31T10:37:57.337Z
- SHA-256 of the archived text
06996b74c618df28e599aa3b3d7c05f2f8d69e66dd8fd291b56e6c6ad879ebed- Stable URL of this page
https://metraipolis.com/documento/dc_acada94cb14e
How to cite
VLMs for Videogame Data Annotation — arXiv:2608.05949 — arXiv (en), https://arxiv.org/abs/2608.05949 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_acada94cb14e (Metraipolis archive dc_acada94cb14e, sha256 06996b74c618df28e599aa3b3d7c05f2f8d69e66dd8fd291b56e6c6ad879ebed)
BibTeX
@misc{dcacada94cb14e,
title = {VLMs for Videogame Data Annotation — arXiv:2608.05949},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.05949},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_acada94cb14e; sha256 06996b74c618df28e599aa3b3d7c05f2f8d69e66dd8fd291b56e6c6ad879ebed},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.05949. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Vision Language Models (VLMs) and Artificial Intelligence (AI) agents have revolutionized how engineers approach complex problems in real-world applications. Their adoption in video games is on the other hand limited by the extreme variability of the synthetic scenarios and their poor compliance with real-world physics. Here we investigate the use of VLMs for annotating video game frame sequences with reward signals, a task with several potential applications including, among others, conditioned training and offline reinforcement learning. We show that VLMs often struggle to answer basic questions on racing video games (although we observed a similar behavior on other game genres) and discuss countermeasures such as VLM output mixing and prompt optimization. We also show how input sequence length, resolution, and question batching affect the annotation quality and its token consumption. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-07 in cs.CV). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.05949 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-31T10:23:31.087Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-08-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).