Metraipolis › archive › dc_d603d31ec2e2

Variance Driven Exploration: A Provable and Efficient Methodology for Pure Exploration in Highly Stochastic Environments — arXiv:2608.21995

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.21995
License (as archived)
CC0-1.0
Archived
2026-10-18T07:42:34.203Z
SHA-256 of the archived text
946e23a8914fde705c591802135966ca77c2e2cbb042d7a186e84172f492f641
Stable URL of this page
https://metraipolis.com/documento/dc_d603d31ec2e2

How to cite

Variance Driven Exploration: A Provable and Efficient Methodology for Pure Exploration in Highly Stochastic Environments — arXiv:2608.21995 — arXiv (en), https://arxiv.org/abs/2608.21995 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d603d31ec2e2 (Metraipolis archive dc_d603d31ec2e2, sha256 946e23a8914fde705c591802135966ca77c2e2cbb042d7a186e84172f492f641)
BibTeX
@misc{dcd603d31ec2e2,
  title = {Variance Driven Exploration: A Provable and Efficient Methodology for Pure Exploration in Highly Stochastic Environments — arXiv:2608.21995},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.21995},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d603d31ec2e2; sha256 946e23a8914fde705c591802135966ca77c2e2cbb042d7a186e84172f492f641},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.21995. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We propose Variance Driven Exploration (VarDE), a principled approach for pure exploration in highly stochastic environments, where the exploration process is dominated by stochastic variance. VarDE is built on a fundamental principle: sampling effort should be allocated to minimize the uncertainty of the final decision. We formalize the uncertainty of the final decision through a smooth decision function and derive allocation rules that explicitly capture how stochastic noise in individual components affects the reliability of the final output. We apply this methodology to three core problems of pure exploration -- Best Arm Identification (BAI), Monte Carlo Tree Search (MCTS), and Best-Policy Identification (BPI) -- with theoretical guarantees on variance decay and simple regret. Empirically, we demonstrate consistent and significant improvements of VarDE over existing methods, with especially strong gains in highly stochastic environments.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-25 in cs.AI).
Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI); Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2608.21995 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-18T07:37:52.845Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).