Metraipolis › archive › dc_ee33fe0127cb

Gödel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement — arXiv:2609.36675

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.36675
License (as archived)
CC0-1.0
Archived
2026-10-07T16:56:38.022Z
SHA-256 of the archived text
9cd8d7068e27ec2ca17ae80d826ca685daa1ee77adb3d64a0faaef3f6ca13a88
Stable URL of this page
https://metraipolis.com/documento/dc_ee33fe0127cb

How to cite

Gödel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement — arXiv:2609.36675 — arXiv (en), https://arxiv.org/abs/2609.36675 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ee33fe0127cb (Metraipolis archive dc_ee33fe0127cb, sha256 9cd8d7068e27ec2ca17ae80d826ca685daa1ee77adb3d64a0faaef3f6ca13a88)
BibTeX
@misc{dcee33fe0127cb,
  title = {Gödel Forest: Balancing Search Depth and Breadth for Data-Centric Recursive Self-Improvement — arXiv:2609.36675},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.36675},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ee33fe0127cb; sha256 9cd8d7068e27ec2ca17ae80d826ca685daa1ee77adb3d64a0faaef3f6ca13a88},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.36675. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Recursive self-improvement (RSI) aims to achieve compounding gains by having models improve themselves. While most existing RSI systems optimize external agent harnesses or prompts around a frozen base model, data-centric RSI directly updates the model's own parameters by training on agent-generated data. However, because validating data strategies requires expensive model training, existing methods face a fundamental dilemma: a single agent gets trapped in narrow directions and lacks exploration breadth, while naive parallel search or heavy trace sharing sacrifices long-horizon search depth. To address this challenge, we introduce G"odel Forest, a multi-agent framework that organizes recursive self-improvement as an ensemble of co-evolving search trees. In G"odel Forest, each agent autonomously grows a persistent tree, deepening, branching, or pruning data strategies based on model feedback to secure depth, while parallel trees explore distinct regions of the data space to expand breadth. Crucially, rather than leaving trees isolated or flooding them with heavy execution logs, a dynamically co-evolving memory connects the forest: agents continuously distill their successes and failures into compact procedural lessons anchored to a global leaderboard. Through this forest ecosystem, a dead-end in one tree instantly warns the whole forest against unpromising paths, while an empirical breakthrough quickly seeds new exploration branches in neighboring trees. Evaluated on RSIBench-Data across six diverse domains, G"odel Forest outperforms the single-agent baseline by an average of 10.70% while reducing wall-clock time on five tasks. Ablations confirm that co-evolving shared memory yields a +7.00% gain over independent parallel search, demonstrating that collective distillation is key to scalable self-improvement. The code is available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.36675 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T16:27:03.226Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).