Metraipolis › archive › dc_7ba8bb2f78f9
Differential Properties of Objective and Value Functions for Discounted Markov Decision Processes with Finite State and Action Sets — arXiv:2610.39326
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.39326
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-01T02:32:13.096Z
- SHA-256 of the archived text
ce77cbf9927a07333f92bd073b0d18d34ce07120639e1304340950659ac3dc92- Stable URL of this page
https://metraipolis.com/documento/dc_7ba8bb2f78f9
How to cite
Differential Properties of Objective and Value Functions for Discounted Markov Decision Processes with Finite State and Action Sets — arXiv:2610.39326 — arXiv (en), https://arxiv.org/abs/2610.39326 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7ba8bb2f78f9 (Metraipolis archive dc_7ba8bb2f78f9, sha256 ce77cbf9927a07333f92bd073b0d18d34ce07120639e1304340950659ac3dc92)
BibTeX
@misc{dc7ba8bb2f78f9,
title = {Differential Properties of Objective and Value Functions for Discounted Markov Decision Processes with Finite State and Action Sets — arXiv:2610.39326},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.39326},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7ba8bb2f78f9; sha256 ce77cbf9927a07333f92bd073b0d18d34ce07120639e1304340950659ac3dc92},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.39326. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This paper studies differential properties of objective functions for discrete-time discounted Markov decision processes (MDPs) with finite state and action sets, when differentiation is considered with respect to the discount factor. Given a fixed discount factor for an MDP, we estimate the norms and seminorms of the objective functions, their derivatives, and the value function at a different discount factor. We then use these estimates to prove that objective functions, their derivatives, and value functions are Lipschitz continuous in discount factors. As a result, if an MDP is solved with a fixed discount factor, then we can estimate the value function at a different discount factor without solving it again.\\ %Following these estimations, we also reveal the relations between the seminorms of objective functions, their behavior when the discount factor approaches $1,$ and the discount factors at which the set of optimal policies changes. Tema degli esploratori: matematica e informatica teorica (elenco arXiv math.OC, nuovi lavori del giorno). Categorie arXiv: Optimization and Control (math.OC). Pagina del lavoro: https://arxiv.org/abs/2610.39326 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-01T02:14:28.316Z dalla pagina https://arxiv.org/list/math.OC/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).