Metraipolis › archive › dc_7d2e5781dd3d
On the Brittleness of Maximum Likelihood Estimation for Gaussian Process Hyperparameter Optimization — arXiv:2608.13793
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.13793
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T02:30:46.299Z
- SHA-256 of the archived text
e7d280c99cb37a72ec8b24f1af0a31464ed155373847e18dd0b6b0507fe6d633- Stable URL of this page
https://metraipolis.com/documento/dc_7d2e5781dd3d
How to cite
On the Brittleness of Maximum Likelihood Estimation for Gaussian Process Hyperparameter Optimization — arXiv:2608.13793 — arXiv (en), https://arxiv.org/abs/2608.13793 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7d2e5781dd3d (Metraipolis archive dc_7d2e5781dd3d, sha256 e7d280c99cb37a72ec8b24f1af0a31464ed155373847e18dd0b6b0507fe6d633)
BibTeX
@misc{dc7d2e5781dd3d,
title = {On the Brittleness of Maximum Likelihood Estimation for Gaussian Process Hyperparameter Optimization — arXiv:2608.13793},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.13793},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7d2e5781dd3d; sha256 e7d280c99cb37a72ec8b24f1af0a31464ed155373847e18dd0b6b0507fe6d633},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.13793. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Machine learning (ML) has become an indispensable part of modern engineering design workflows. A crucial step in training an ML model is the selection of the loss function which can be systematically formulated via various techniques such as maximum likelihood estimation (MLE) and cross-validation . While MLE is one of the most popular, effective, and intuitive mechanisms for training ML models, it is brittle: if the assumptions underpinning it are not met, the trained ML model may generalize poorly. This brittleness affects even Gaussian processes (GPs) which are widely used in engineering design and are often (incorrectly) presumed to be very robust to overfitting. In this paper, we fundamentally evaluate the brittleness of MLE in the context of training GPs for probabilistic regression or classification tasks. We compare theoretically grounded metrics against MLE and propose practical solutions. Our extensive studies demonstrate the effectiveness of our solutions in downstream design tasks such as Bayesian optimization and provide a blueprint for practitioners to build accurate and robust GPs that can even outperform tabular foundation models in terms of prediction accuracy, uncertainty quantification, and inference cost. Our contributions are publicly available via GitHub at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-17 in cs.LG). Categorie arXiv: Machine Learning (stat.ML) ; Machine Learning (cs.LG); Methodology (stat.ME). Pagina del lavoro: https://arxiv.org/abs/2608.13793 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T02:26:17.823Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).