Metraipolis › archive › dc_43da14e2f9dc

HamFormer: A Hamiltonian Flow-based SE(3)-Transformer for Conformation Optimization — arXiv:2611.00875

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.00875
License (as archived)
CC0-1.0
Archived
2026-11-03T11:20:48.066Z
SHA-256 of the archived text
f13aee3f478f5d708e49d3183750dee3e6d96c69ba362405c2fee2838c9981e9
Stable URL of this page
https://metraipolis.com/documento/dc_43da14e2f9dc

How to cite

HamFormer: A Hamiltonian Flow-based SE(3)-Transformer for Conformation Optimization — arXiv:2611.00875 — arXiv (en), https://arxiv.org/abs/2611.00875 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_43da14e2f9dc (Metraipolis archive dc_43da14e2f9dc, sha256 f13aee3f478f5d708e49d3183750dee3e6d96c69ba362405c2fee2838c9981e9)
BibTeX
@misc{dc43da14e2f9dc,
  title = {HamFormer: A Hamiltonian Flow-based SE(3)-Transformer for Conformation Optimization — arXiv:2611.00875},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00875},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_43da14e2f9dc; sha256 f13aee3f478f5d708e49d3183750dee3e6d96c69ba362405c2fee2838c9981e9},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00875. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

The Transformer architecture plays a central role in modern deep learning, and its SE(3)-equivariant variants have been widely applied to molecular conformation modeling and optimization. Given its importance, many methods attempt to interpret and improve the Transformer through the lens of dynamics. However, they mainly focus on a single attention head rather than the full Transformer architecture and seldom consider SE(3)-equivariance in their proposed models. In this study, we propose an improved SE(3)-Transformer architecture, called HamFormer, which revisits the design of SE(3)-Transformer through the lens of Hamiltonian flow. In particular, we define a parametrized Hamiltonian flow in the phase space of position and velocity, corresponding to optimizing an energy functional that combines an optimal transport-based potential with a damped momentum. The Lie-Trotter splitting framework of the Hamiltonian flow leads to the proposed HamFormer architecture, whose feedforward computation achieves the optimization step of the proposed energy functional. Furthermore, we combine HamFormer with Equivariant Graph Neural Network (EGNN), build a new model for molecular conformation optimization. Extensive experiments on molecular ground-state conformation prediction show that HamFormer provides a strong and physically interpretable surrogate for classic SE(3)-Transformer and generally outperforms state-of-the-art competitors.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2611.00875 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T11:02:37.479Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).