Metraipolis › archive › dc_9dd04488a80f
Always-On Experimentation — arXiv:2609.38695
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.38695
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T12:44:08.085Z
- SHA-256 of the archived text
9ed369204b369502d2f759998a9cd437557ed4b97c056f0bda3ef9d05c14f9e2- Stable URL of this page
https://metraipolis.com/documento/dc_9dd04488a80f
How to cite
Always-On Experimentation — arXiv:2609.38695 — arXiv (en), https://arxiv.org/abs/2609.38695 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9dd04488a80f (Metraipolis archive dc_9dd04488a80f, sha256 9ed369204b369502d2f759998a9cd437557ed4b97c056f0bda3ef9d05c14f9e2)
BibTeX
@misc{dc9dd04488a80f,
title = {Always-On Experimentation — arXiv:2609.38695},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.38695},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9dd04488a80f; sha256 9ed369204b369502d2f759998a9cd437557ed4b97c056f0bda3ef9d05c14f9e2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.38695. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Generative AI has dramatically accelerated the rate at which new treatments---from novel pharmaceuticals to online marketing campaigns---can be conceived and deployed. As a result, modern experimentation platforms often run continuously, with treatments added as they are ready and removed when they underperform. We formalize this "Always-On" experimental setting, in which treatments can be dynamically generated, added to, and removed from a running experiment, and study the statistical problem of deciding whether to accept or reject each treatment while controlling for the false discovery rate. We develop sequential tests that achieve time-uniform Type-I error control under arbitrary stopping times and "predictable" treatment schedules. Our approach builds on the testing-by-betting framework: we construct test supermartingales for testing the average treatment effect of each treatment, and show that the construction of these test supermartingales is growth-rate optimal in an almost-sure sense. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-10-01 in cs.AI). Categorie arXiv: Methodology (stat.ME) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.38695 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T12:14:13.924Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-10-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).