Metraipolis › archive › dc_ea297869bb7c
ParetoRSI-Gym: Can AI Agents Improve Language Models Across Multiple Domains? — arXiv:2610.34386
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.34386
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-27T08:01:23.771Z
- SHA-256 of the archived text
fdaba5cd2a48adb67fd9e37fc097d853740c5fe758263b6679e3eb9ced304006- Stable URL of this page
https://metraipolis.com/documento/dc_ea297869bb7c
How to cite
ParetoRSI-Gym: Can AI Agents Improve Language Models Across Multiple Domains? — arXiv:2610.34386 — arXiv (en), https://arxiv.org/abs/2610.34386 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ea297869bb7c (Metraipolis archive dc_ea297869bb7c, sha256 fdaba5cd2a48adb67fd9e37fc097d853740c5fe758263b6679e3eb9ced304006)
BibTeX
@misc{dcea297869bb7c,
title = {ParetoRSI-Gym: Can AI Agents Improve Language Models Across Multiple Domains? — arXiv:2610.34386},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.34386},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ea297869bb7c; sha256 fdaba5cd2a48adb67fd9e37fc097d853740c5fe758263b6679e3eb9ced304006},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.34386. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Recursive self-improvement (RSI) requires an agentic system to design, train, and evaluate its own successor. Data-driven post-training is a central part of that loop, yet existing evaluations measure it on a single benchmark, where an agent selects from a static pool or distills a stronger model to push one score up in one run. Real post-training is multi-domain, and a gain in one domain has to be weighed against a regression in another. We propose ParetoRSI-Gym, in which an agent searches for data, curates it, trains, reads back per-domain results, and repeats, with everything but the data held fixed: the initial LLM, the five domains (math, code, finance, medicine, science), the toolset, and the SFT pipeline. Generalization benchmarks in each domain separate capability gains from overfitting to the scores the agent optimizes against. Across three agent systems, three base models, five rounds and multiple seeds, the strongest system, Claude Code with Opus-5, raises the generalization scores of its proxy-best checkpoint by 9.2% relative to the starting model (+2.3 absolute points), averaged with equal weight over three base models and five domains, with a single-domain relative gain of up to 63% (medicine on Ministral-3-3B). Further analysis shows that the harness matters as much as the model it drives, and that each agent keeps a unique data selection strategy. We see our work as a step towards evaluation of RSI systems in real-world machine learning engineering. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.34386 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-27T07:55:30.900Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).