Metraipolis › archive › dc_dec952084705

Automatic Construction of Strong Simple Baselines — arXiv:2610.40700

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.40700
License (as archived)
CC0-1.0
Archived
2026-11-02T04:51:24.856Z
SHA-256 of the archived text
d8392bfda1842a414b6b15b8e06dc9d4f6690cf3d123dce166fb0f7e33d8b0a6
Stable URL of this page
https://metraipolis.com/documento/dc_dec952084705

How to cite

Automatic Construction of Strong Simple Baselines — arXiv:2610.40700 — arXiv (en), https://arxiv.org/abs/2610.40700 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_dec952084705 (Metraipolis archive dc_dec952084705, sha256 d8392bfda1842a414b6b15b8e06dc9d4f6690cf3d123dce166fb0f7e33d8b0a6)
BibTeX
@misc{dcdec952084705,
  title = {Automatic Construction of Strong Simple Baselines — arXiv:2610.40700},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.40700},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_dec952084705; sha256 d8392bfda1842a414b6b15b8e06dc9d4f6690cf3d123dce166fb0f7e33d8b0a6},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.40700. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

To rigorously establish the value of a novel deep learning method, it must be compared against appropriate baselines. As deep learning has become increasingly common in the physical and life sciences, there have been numerous cases in which apparent progress has turned out to be an artifact of omitted or missing baselines. In this work, we investigate whether this problem can be mitigated by using large language models to automate the construction of baselines. We assemble 36 supervised classification and regression tasks from peer-reviewed studies in Nature, Science, and Cell-family journals that investigate novel deep learning methods for scientific applications. We then use a language model to construct simple baselines for each task. These automatically constructed baselines are strong, recovering a median of 95.5% (mean 85.7%) of the gap between a trivial predictor and the score of the deep learning model. The median simple baseline matches or exceeds the performance of the deep learning model in 12 studies. We further examine the variation across scientific domains and publication venues and we characterize the effects of test-time compute and access to different levels of study context. As human peer review has struggled to keep up with the rapidly increasing volume of research articles in recent years, our results suggest that automated baseline construction is a practical and scalable check on deep learning contributions in the physical and life sciences.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Quantitative Methods (q-bio.QM).
Pagina del lavoro: https://arxiv.org/abs/2610.40700 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-02T04:45:12.827Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).