Metraipolis › archive › dc_dab420dd72eb

SciExam for ENSO: Can AI Agents Build Climate Models? — arXiv:2610.10513

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.10513
License (as archived)
CC0-1.0
Archived
2026-10-08T11:09:58.326Z
SHA-256 of the archived text
0344d6c59a9510de5d4cfb49847ef74868be111355daa9e0cd0e8b79a22c5320
Stable URL of this page
https://metraipolis.com/documento/dc_dab420dd72eb

How to cite

SciExam for ENSO: Can AI Agents Build Climate Models? — arXiv:2610.10513 — arXiv (en), https://arxiv.org/abs/2610.10513 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_dab420dd72eb (Metraipolis archive dc_dab420dd72eb, sha256 0344d6c59a9510de5d4cfb49847ef74868be111355daa9e0cd0e8b79a22c5320)
BibTeX
@misc{dcdab420dd72eb,
  title = {SciExam for ENSO: Can AI Agents Build Climate Models? — arXiv:2610.10513},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.10513},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_dab420dd72eb; sha256 0344d6c59a9510de5d4cfb49847ef74868be111355daa9e0cd0e8b79a22c5320},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.10513. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Language-model agents are increasingly asked to carry out open-ended scientific research, yet their results are usually graded against a known answer, a rubric, or a language-model reviewer, none of which can tell whether a new scientific model is valid. The AI Science Exam for El Nino-Southern Oscillation (SciExam for ENSO) is a benchmark in which agents build low-order stochastic models of ENSO, the dominant mode of interannual climate variability, from real observations. Within a six-hour budget, agents process the observations, write their own diagnostics, which are then frozen, and develop a model using only these diagnostics as feedback. Hidden graders then test whether the model reproduces ENSO's statistics, recovers unobserved variables, and forecasts held-out years, and score a published model in the same way. Across twelve agent systems, six produce models that score higher than the published model, mainly through better reconstruction and forecasting. The simplified forms of the stronger models are each compatible with one of the two competing explanations of ENSO's warm-cold asymmetry, an open debate that the task never mentions. Controlled runs of the top system under varied information suggest that its scores do not come from recalling the dated observational record and that the information it receives shapes how it builds its model. SciExam for ENSO can thus evaluate agent research where no answer is known, and the results suggest that agents can already build competitive models whose structures bear on questions that scientists still debate.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG); Atmospheric and Oceanic Physics (physics.ao-ph).
Pagina del lavoro: https://arxiv.org/abs/2610.10513 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T10:14:05.995Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).