Metraipolis › archive › dc_bec44a336697

Dynamic Discrete Choice and Inverse Reinforcement Learning: Inferring Preferences and Beliefs From Human Behavior — arXiv:2608.24362

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.24362
License (as archived)
CC0-1.0
Archived
2026-10-18T07:33:45.429Z
SHA-256 of the archived text
67896029ac06d41a639b68836d72e0bf53023cfc66e051578a916eee319b278d
Stable URL of this page
https://metraipolis.com/documento/dc_bec44a336697

How to cite

Dynamic Discrete Choice and Inverse Reinforcement Learning: Inferring Preferences and Beliefs From Human Behavior — arXiv:2608.24362 — arXiv (en), https://arxiv.org/abs/2608.24362 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_bec44a336697 (Metraipolis archive dc_bec44a336697, sha256 67896029ac06d41a639b68836d72e0bf53023cfc66e051578a916eee319b278d)
BibTeX
@misc{dcbec44a336697,
  title = {Dynamic Discrete Choice and Inverse Reinforcement Learning: Inferring Preferences and Beliefs From Human Behavior — arXiv:2608.24362},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.24362},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_bec44a336697; sha256 67896029ac06d41a639b68836d72e0bf53023cfc66e051578a916eee319b278d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.24362. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

This article surveys two deeply connected literatures that approach the same fundamental problem from different disciplinary traditions: dynamic discrete choice (DDC) in structural econometrics and inverse reinforcement learning (IRL) in machine learning. Both seek to infer the preferences of decision makers from observed sequential behavior, assuming that individuals act to maximize an expected reward function within a dynamic, uncertain environment formalized as a Markov decision process (MDP). Despite independent origins, the two fields have converged on similar mathematical formulations. We show that the (soft Q-learning) framework now prevalent in IRL is closely related to DDC models under additive extreme value preference shocks, yielding the same softmax (multinomial logit) choice probabilities and smooth Bellman equations that underpin structural estimation in economics. We compare the estimation and computational methods developed in each field. DDC has emphasized maximum likelihood estimation, conditional choice probability estimators, and policy iteration methods. IRL has developed scalable alternatives, including maximum entropy methods, adversarial approaches, and model-free temporal difference estimators that extend to high-dimensional state spaces using deep neural networks. Model-free IRL estimators that combine temporal difference learning with classical two-step methods from econometrics represent a promising direction for bridging the two literatures. Both fields confront shared foundational challenges: the identification problem, whereby multiple reward functions can rationalize the same observed behavior, and the curse of dimensionality in solving the underlying MDP. We believe that cross-fertilization offers substantial opportunities for methodological progress in both fields.

Tema degli esploratori: economia dei servizi IA (retro-catalogo arXiv: annunci del 2026-08-26 in econ.EM).
Categorie arXiv: Econometrics (econ.EM).
Pagina del lavoro: https://arxiv.org/abs/2608.24362 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T07:28:35.360Z dalla pagina https://arxiv.org/catchup/econ.EM/2026-08-26?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).