Metraipolis › archive › dc_04d32bfe4587

Simultaneous Forward and Inverse Human-in-the-Loop Optimization — arXiv:2609.22630

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.22630
License (as archived)
CC0-1.0
Archived
2026-10-09T22:23:30.782Z
SHA-256 of the archived text
b2cd7482e977f9338a2b6f5f7c7a8c91fe4173885dbaf7ce71b5e15c3e4f9fa2
Stable URL of this page
https://metraipolis.com/documento/dc_04d32bfe4587

How to cite

Simultaneous Forward and Inverse Human-in-the-Loop Optimization — arXiv:2609.22630 — arXiv (en), https://arxiv.org/abs/2609.22630 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_04d32bfe4587 (Metraipolis archive dc_04d32bfe4587, sha256 b2cd7482e977f9338a2b6f5f7c7a8c91fe4173885dbaf7ce71b5e15c3e4f9fa2)
BibTeX
@misc{dc04d32bfe4587,
  title = {Simultaneous Forward and Inverse Human-in-the-Loop Optimization — arXiv:2609.22630},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.22630},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_04d32bfe4587; sha256 b2cd7482e977f9338a2b6f5f7c7a8c91fe4173885dbaf7ce71b5e15c3e4f9fa2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.22630. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Subjective user experience is important to human-robot interaction, but the outcomes users value, and how those preferences vary across individuals and contexts, are often unknown. While inverse learning approaches using human data can help identify user rewards, in many assistive settings the experimental costs of executing a control policy, measuring biomechanical or physiological outcomes, and collecting user feedback often limit the number of queries and optimization iterations. Here, we present Simultaneous Forward and Inverse Human-In-the-Loop Optimization (SFIHILO), which efficiently infers individual-specific reward functions from preferences over human outcomes and identifies a final control policy that maximizes the learned reward. SFIHILO bootstraps a forward model to predict user outcomes from control policies, uses this model for active querying to accelerate inverse reward learning, and then optimizes the final control policy without additional user trials. We score candidate policies by their expected reduction in uncertainty across both forward and inverse beliefs, targeting a regional preference boundary to robustly inform this simultaneous learning process. In simulation, we show that SFIHILO was effective across user heterogeneity, outcome dimensionalities, precision requirements, noise levels, and nonstationarity; compared with mutual information approaches, the proposed active querying strategy significantly improved sample efficiency in inverse learning while preserving forward model accuracy. This approach demonstrates the potential to infer latent human goals, enabling more transferable and effective human-robot interaction.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-22 in cs.RO).
Categorie arXiv: Robotics (cs.RO).
Pagina del lavoro: https://arxiv.org/abs/2609.22630 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T21:59:59.452Z dalla pagina https://arxiv.org/catchup/cs.RO/2026-09-22?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).