Metraipolis › archive › dc_06cec1ceb606

Isotropic Gaussian Processes Improve Vanilla Bayesian Optimization in High Dimensions — arXiv:2610.05780

Source
arXiv
Original
https://arxiv.org/abs/2610.05780
License (as archived)
CC0-1.0
Archived
2026-10-06T05:32:21.802Z
SHA-256 of the archived text
b663f8e8867f90ef328c47a13a670395e369a413be77fbf21d4db7f310714e1c
Stable URL of this page
https://metraipolis.com/documento/dc_06cec1ceb606

How to cite

Isotropic Gaussian Processes Improve Vanilla Bayesian Optimization in High Dimensions — arXiv:2610.05780 — arXiv, https://arxiv.org/abs/2610.05780 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_06cec1ceb606 (Metraipolis archive dc_06cec1ceb606, sha256 b663f8e8867f90ef328c47a13a670395e369a413be77fbf21d4db7f310714e1c)
BibTeX
@misc{dc06cec1ceb606,
  title = {Isotropic Gaussian Processes Improve Vanilla Bayesian Optimization in High Dimensions — arXiv:2610.05780},
  howpublished = {arXiv},
  url = {https://arxiv.org/abs/2610.05780},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_06cec1ceb606; sha256 b663f8e8867f90ef328c47a13a670395e369a413be77fbf21d4db7f310714e1c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.05780. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

High-dimensional Bayesian optimization (BO) often fits Gaussian process (GP) surrogates from far fewer observations than input dimensions. Modern Vanilla BO can perform well in this regime with dimension-aware priors, initialization, and acquisition optimization, but it typically retains automatic relevance determination (ARD), fitting one lengthscale per input coordinate. We study this modeling choice and propose Iso-BO, a controlled modification that replaces the ARD GP with an isotropic GP using one shared lengthscale while keeping the surrounding BO pipeline matched. For radial kernels, we show that the marginal log likelihood (MLL) depends on the inverse-squared ARD lengthscales only through weighted pairwise distances among the observed inputs. The current design can therefore leave some ARD directions exactly invisible or only weakly constrained by the MLL. Iso-BO removes coordinatewise reweighting and fits a single shared scale instead. Lengthscale-fitting and predictive-density diagnostics show that this finite-data effect appears in practice, including when the data-generating process is anisotropic. Across GP-prior, synthetic, and real-world benchmarks, Iso-BO often improves over matched modern Vanilla BO and remains competitive with the included high-dimensional BO baselines under the tested budgets. Stress tests also show the expected boundary wherein sufficiently strong, learnable anisotropy can favor the more flexible ARD model.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (stat.ML) ; Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2610.05780 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T05:27:06.010Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).