Metraipolis › archive › dc_28742d4faaa7
Offline Policy Evaluation as a decision support tool for designing Adaptive Experiments — arXiv:2609.30273
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.30273
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-08T02:10:14.827Z
- SHA-256 of the archived text
f1af3e7b8f38dad37a72d9dde881aa20477d63dd45e9a2f362bfd102d6721011- Stable URL of this page
https://metraipolis.com/documento/dc_28742d4faaa7
How to cite
Offline Policy Evaluation as a decision support tool for designing Adaptive Experiments — arXiv:2609.30273 — arXiv (en), https://arxiv.org/abs/2609.30273 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_28742d4faaa7 (Metraipolis archive dc_28742d4faaa7, sha256 f1af3e7b8f38dad37a72d9dde881aa20477d63dd45e9a2f362bfd102d6721011)
BibTeX
@misc{dc28742d4faaa7,
title = {Offline Policy Evaluation as a decision support tool for designing Adaptive Experiments — arXiv:2609.30273},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.30273},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_28742d4faaa7; sha256 f1af3e7b8f38dad37a72d9dde881aa20477d63dd45e9a2f362bfd102d6721011},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.30273. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We investigate how historical data from fixed randomized experiments (A/B tests) can be used to inform the deployment of adaptive experiments based on contextual bandits. Given data collected under a static allocation, our goal is to assess which adaptive policies, if any, would have outperformed the original design and under what conditions. To this end, we combine off-policy evaluation (OPE) with a controlled warm-start simulation. From logged A/B test data exhibiting heterogeneous treatment effects, we estimate nuisance components and use doubly robust estimators to rank a portfolio of pre-specified adaptive and non-adaptive policies. When ground truth is available, we then deploy the same offline-trained policies in a simulator that reuses the exact data-generating reward probabilities, providing a safe, ground-truth-anchored environment to study the offline-to-online transition under warm starting. Using synthetic randomized controlled trials with known heterogeneity structures and an oracle policy, our results indicate that adaptive, context-aware policies improve upon fixed allocations when meaningful heterogeneity is present, while providing little benefit in its absence. We reinforce our findings on standard open benchmarks (Hillstrom, Criteo Uplift, and LaLonde), reinterpreted through a policy-value and regret perspective. Overall, our results provide a practical methodology for deciding when adaptive experimentation is worth deploying and how to select among competing adaptive policies using existing A/B test data. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-28 in cs.LG). Categorie arXiv: Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.30273 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-08T01:43:06.633Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).