Metraipolis › archive › dc_548807f59933

PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models — arXiv:2609.14973

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.14973
License (as archived)
CC0-1.0
Archived
2026-10-16T01:53:20.443Z
SHA-256 of the archived text
dab27451e384b7bc6fe592e210b14bb9177d57a6ec247233ddee4e68d3fac169
Stable URL of this page
https://metraipolis.com/documento/dc_548807f59933

How to cite

PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models — arXiv:2609.14973 — arXiv (en), https://arxiv.org/abs/2609.14973 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_548807f59933 (Metraipolis archive dc_548807f59933, sha256 dab27451e384b7bc6fe592e210b14bb9177d57a6ec247233ddee4e68d3fac169)
BibTeX
@misc{dc548807f59933,
  title = {PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models — arXiv:2609.14973},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.14973},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_548807f59933; sha256 dab27451e384b7bc6fe592e210b14bb9177d57a6ec247233ddee4e68d3fac169},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.14973. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We present PhysBrain 1.5, a unified model for understanding physical environments, generating actions, and predicting future states. Motivated by the physical loop of observation, interaction, and environmental change, we bring these capabilities into a common learning framework. Starting from a general vision--language model, we encode language responses, end-effector motion, and dense visual targets as discrete sequences and jointly optimize them with autoregressive next-token prediction. Pre-training draws its embodied supervision entirely from human interaction videos, using task-centered episodes to pair semantic and spatial context with recovered motion and subsequent observations. We then adapt the model through supervised fine-tuning on a mixture of human demonstrations, robot trajectories, and simulated experience. Across 28 embodied understanding benchmarks, our 8B model achieves an average score of 72.5, setting a new open-source state of the art and performing on par with leading proprietary models such as GPT-6-Astra and Gemini 3.6 Flash. It achieves the best open-source results on 14 benchmarks while retaining general multimodal capabilities. Beyond these understanding evaluations, qualitative examples show the model's ability to produce end-effector trajectories and predict future scenes through spatially aligned RGB, depth, and robot-mask outputs.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-15 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.14973 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T01:25:23.630Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).