Metraipolis › archive › dc_5080c8ff0385

Thermo-VLA: A Thermal-Aware Vision-Language-Action Model with Gated Residual Modulation for Robotic Manipulation — arXiv:2611.11981

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.11981
License (as archived)
CC0-1.0
Archived
2026-11-10T18:43:49.975Z
SHA-256 of the archived text
448ce0e1e1c13b1954f26aa864bd070924c550e4030363cbeb2168504283693e
Stable URL of this page
https://metraipolis.com/documento/dc_5080c8ff0385

How to cite

Thermo-VLA: A Thermal-Aware Vision-Language-Action Model with Gated Residual Modulation for Robotic Manipulation — arXiv:2611.11981 — arXiv (en), https://arxiv.org/abs/2611.11981 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_5080c8ff0385 (Metraipolis archive dc_5080c8ff0385, sha256 448ce0e1e1c13b1954f26aa864bd070924c550e4030363cbeb2168504283693e)
BibTeX
@misc{dc5080c8ff0385,
  title = {Thermo-VLA: A Thermal-Aware Vision-Language-Action Model with Gated Residual Modulation for Robotic Manipulation — arXiv:2611.11981},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.11981},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_5080c8ff0385; sha256 448ce0e1e1c13b1954f26aa864bd070924c550e4030363cbeb2168504283693e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.11981. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recent Vision-Language-Action (VLA) models have begun incorporating thermal sensing, but existing approaches typically treat thermal images as ordinary visual inputs, providing limited support for temperature-aware relational reasoning in manipulation. To address this limitation, we propose Thermo-VLA with a ThermoRes Encoder, which decomposes thermal images into cold and hot attribute representations and injects them into the RGB token through language-conditioned residual modulation, enabling temperature-driven target selection and continuous manipulation. We further construct six real-world robotic tasks on a dual-arm Unitree G1 platform, spanning basic grounding to relational reasoning. Experiments show that Thermo-VLA achieves an average success rate of 0.86 across four thermal-dependent tasks, outperforming a pi_0.5 baseline that directly incorporates RGB-thermal observations by 18 percentage points. Under unseen-object and scene variations, Thermo-VLA maintains an average success rate of 0.78, achieving the best generalisation performance among the compared methods. Beyond thermal sensing, we transfer the same residual modulation mechanism to colour attributes and observe consistent improvements in both simulation and real-robot experiments, indicating its potential to generalise beyond thermal attributes. Project website: this https URL

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Robotics (cs.RO) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.11981 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-10T18:37:37.671Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).