Metraipolis › archive › dc_5bf47bf4bd41

Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State — arXiv:2609.33497

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.33497
License (as archived)
CC0-1.0
Archived
2026-10-07T22:37:30.156Z
SHA-256 of the archived text
4d73c30fee8b2101f6a20d8741cbad8d047c219bef6e936d85f8e4b4958e71ca
Stable URL of this page
https://metraipolis.com/documento/dc_5bf47bf4bd41

How to cite

Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State — arXiv:2609.33497 — arXiv (en), https://arxiv.org/abs/2609.33497 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_5bf47bf4bd41 (Metraipolis archive dc_5bf47bf4bd41, sha256 4d73c30fee8b2101f6a20d8741cbad8d047c219bef6e936d85f8e4b4958e71ca)
BibTeX
@misc{dc5bf47bf4bd41,
  title = {Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State — arXiv:2609.33497},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.33497},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_5bf47bf4bd41; sha256 4d73c30fee8b2101f6a20d8741cbad8d047c219bef6e936d85f8e4b4958e71ca},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33497. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Planning from pixels needs more than a latent space that is stable and predictable. The state the planner scores must also be organized by how actions move the system. Joint-embedding predictive architectures (JEPAs) avoid pixel reconstruction by predicting future representations, but existing action-conditioned JEPAs ask one embedding to serve both perception and control. We introduce H-JEPA, which separates the two. A wide perceptual code is regularized toward a well-scaled isotropic geometry with a Bures-Wasserstein prior, and a fixed orthonormal slice of that code is the control state, which inherits the code's covariance without any objective of its own. The state evolves under phase-conditioned dissipative port-Hamiltonian dynamics whose input port has orthonormal columns. Port-inverse consistency (PIC) reads the executed action back through the transpose of that port. We show that this readout is exactly the rollout error projected onto the port directions, so PIC is a parameter-free reweighting of prediction error and not an auxiliary action decoder. Untying the readout from the port breaks this identity and loses half of the gain. H-JEPA matches or exceeds reconstruction-free baselines, including the action-decoding Delta-JEPA, on four pixel-based control benchmarks after at most $10$ training epochs, and its largest gain is on OGB-Cube ($91.9$ against $79.3$ percent). Ablations on PushT and OGB-Cube separate the contributions of the structured predictor, PIC, the prediction horizon, the state rank, and the anti-collapse prior.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.33497 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T22:14:27.962Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).