Metraipolis › archive › dc_d9b890e600bf

Automatic Construction of Strong Simple Baselines — arXiv:2610.40700

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.40700
License (as archived)
CC0-1.0
Archived
2026-11-03T05:40:29.205Z
SHA-256 of the archived text
6e1634da3c7a93e45ca527b7cd2929f5c3aace4cb83348101b51db7426f3934d
Stable URL of this page
https://metraipolis.com/documento/dc_d9b890e600bf

How to cite

Automatic Construction of Strong Simple Baselines — arXiv:2610.40700 — arXiv (en), https://arxiv.org/abs/2610.40700 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d9b890e600bf (Metraipolis archive dc_d9b890e600bf, sha256 6e1634da3c7a93e45ca527b7cd2929f5c3aace4cb83348101b51db7426f3934d)
BibTeX
@misc{dcd9b890e600bf,
  title = {Automatic Construction of Strong Simple Baselines — arXiv:2610.40700},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.40700},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d9b890e600bf; sha256 6e1634da3c7a93e45ca527b7cd2929f5c3aace4cb83348101b51db7426f3934d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.40700. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

To rigorously establish the value of a novel deep learning method, it must be compared against appropriate baselines. As deep learning has become increasingly common in the physical and life sciences, there have been numerous cases in which apparent progress has turned out to be an artifact of omitted or missing baselines. In this work, we investigate whether this problem can be mitigated by using large language models to automate the construction of baselines. We assemble 36 supervised classification and regression tasks from peer-reviewed studies in Nature, Science, and Cell-family journals that investigate novel deep learning methods for scientific applications. We then use a language model to construct simple baselines for each task. These automatically constructed baselines are strong, recovering a median of 95.5% (mean 85.7%) of the gap between a trivial predictor and the score of the deep learning model. The median simple baseline matches or exceeds the performance of the deep learning model in 12 studies. We further examine the variation across scientific domains and publication venues and we characterize the effects of test-time compute and access to different levels of study context. As human peer review has struggled to keep up with the rapidly increasing volume of research articles in recent years, our results suggest that automated baseline construction is a practical and scalable check on deep learning contributions in the physical and life sciences.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Quantitative Methods (q-bio.QM).
Pagina del lavoro: https://arxiv.org/abs/2610.40700 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T05:24:38.806Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).