Metraipolis › archive › dc_197463c26c4a
CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations — arXiv:2609.08250
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.08250
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T15:12:46.606Z
- SHA-256 of the archived text
fccb98552bb81600f7d5daec345e93d52e7ffca5629d3672a19e71985065d6fb- Stable URL of this page
https://metraipolis.com/documento/dc_197463c26c4a
How to cite
CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations — arXiv:2609.08250 — arXiv (en), https://arxiv.org/abs/2609.08250 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_197463c26c4a (Metraipolis archive dc_197463c26c4a, sha256 fccb98552bb81600f7d5daec345e93d52e7ffca5629d3672a19e71985065d6fb)
BibTeX
@misc{dc197463c26c4a,
title = {CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations — arXiv:2609.08250},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.08250},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_197463c26c4a; sha256 fccb98552bb81600f7d5daec345e93d52e7ffca5629d3672a19e71985065d6fb},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.08250. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
How far a pushed object slides depends on its mass and friction, which no single image reveals. Pretrained visual encoders are increasingly used as the perception front end of world models for manipulation, and their physical competence is assessed with perturbation benchmarks and linear probes, almost always in a clean, fixed-camera scene. We show that these assessments cannot distinguish an encoder that infers physics from one that does not. CALIPER (calibrate, then predict) is a direct test: an object of unknown mass and friction is struck twice at known speeds, a third strike is shown only up to the moment of contact, and a linear readout on frozen features must predict how far the object slides. Swapping in another object's calibration clips checks that the evidence is actually used. Across 2,000 simulated episodes and eight representations, from V-JEPA 2 to a randomly initialised ViT and raw pixels, calibration adds +0.50 R^2 and the swap removes it. Yet in the clean scene every representation lands within 0.02 R^2 of the ceiling set by true simulator state, because a fixed camera exposes the object's displacement directly in pixel coordinates. Resampling camera, lighting, and clutter for every clip spreads the same representations across 0.50 R^2; when the readout chooses a push speed for a goal distance, V-JEPA 2 misses by 4 mm and the random ViT by 20 mm, no better than ignoring the object. Linear probes track none of this: a change in frame aggregation moves a probe more than pretraining does, and erasing the probed mass direction from the same representation costs nothing in one scene and 0.35 R^2 in the other. Whether a benchmark can rank models is an empirical property, and we give three checks that establish it. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CV). Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.08250 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T14:49:57.443Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).