Metraipolis › archive › dc_0aea1ace8237
Cost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice? — arXiv:2610.42085
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.42085
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T08:12:39.233Z
- SHA-256 of the archived text
4a944ed114a0bcb2b9d8c0175965ac26d1017aa37762f92e74874ca637a30d1e- Stable URL of this page
https://metraipolis.com/documento/dc_0aea1ace8237
How to cite
Cost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice? — arXiv:2610.42085 — arXiv (en), https://arxiv.org/abs/2610.42085 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0aea1ace8237 (Metraipolis archive dc_0aea1ace8237, sha256 4a944ed114a0bcb2b9d8c0175965ac26d1017aa37762f92e74874ca637a30d1e)
BibTeX
@misc{dc0aea1ace8237,
title = {Cost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice? — arXiv:2610.42085},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.42085},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0aea1ace8237; sha256 4a944ed114a0bcb2b9d8c0175965ac26d1017aa37762f92e74874ca637a30d1e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.42085. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Freeze-thaw Bayesian optimization (BO) evaluates candidates in resumable increments but usually stops at a budget or convergence test. We maximize a budget-free utility, the best observed score minus a cost per increment, with a one-step lookahead: advance the candidate with the largest expected improvement (EI) under a fixed surrogate, and stop once no EI exceeds the cost. This rule, EI stopping, never falls below stopping immediately in expected utility, yet it can stop too early. We construct a certificate, a lower bound on the value of two-step lookahead, that proves such a stop premature, and repeating this correction never lowers expected utility under the surrogate. Under the surrogate, EI stops are premature on average at low costs and lose little at high costs. On three hyperparameter optimization benchmarks, a pre-registered test finds EI stopping noninferior to the correction in most high-cost settings, while the correction gains at low costs on two of the three; more information sharing in the surrogate raises EI stopping's utility. On the surrogates of two published methods, EI stopping trades lower scores for fewer training increments. EI stopping is a simple cost-aware reference whose utility depends on the surrogate. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Optimization and Control (math.OC); Machine Learning (stat.ML). Pagina del lavoro: https://arxiv.org/abs/2610.42085 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T08:02:38.952Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).