Metraipolis › archive › dc_613b468cc820
The Evolution Strategies Paradox: Better Models from Worse Perturbations — arXiv:2611.04113
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.04113
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-04T21:37:45.623Z
- SHA-256 of the archived text
78a2a5d45fb1ead6d520250e623c9a81d12311a21fd8b4359c831e042f720e4b- Stable URL of this page
https://metraipolis.com/documento/dc_613b468cc820
How to cite
The Evolution Strategies Paradox: Better Models from Worse Perturbations — arXiv:2611.04113 — arXiv (en), https://arxiv.org/abs/2611.04113 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_613b468cc820 (Metraipolis archive dc_613b468cc820, sha256 78a2a5d45fb1ead6d520250e623c9a81d12311a21fd8b4359c831e042f720e4b)
BibTeX
@misc{dc613b468cc820,
title = {The Evolution Strategies Paradox: Better Models from Worse Perturbations — arXiv:2611.04113},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.04113},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_613b468cc820; sha256 78a2a5d45fb1ead6d520250e623c9a81d12311a21fd8b4359c831e042f720e4b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04113. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
How is it possible for perturbation-based methods like Evolution Strategies (ES) to optimize billion-parameter large language models (LLMs)? Classical search methods are highly dependent on finding good candidates within generated populations. However, when using ES to fine-tune LLMs, a phenomenon can occur where all offspring models consistently perform worse than the parent model, yet during training, the parent model consistently improves. This paradox occurs across models, tasks, and even modalities. This paper characterizes the paradox, then examines how the local reward landscape and properties of the ES estimator contribute to it: in high-dimensional spaces, exploration leads to worse performance, yet still highlights good directions; aggregating those directions then allows for making local improvements. The result can be seen as a new optimization paradigm where a principled interaction of noise and curvature produces the paradox as a byproduct of effective optimization. These findings provide guidance for taking advantage of perturbation-based methods in LLM fine-tuning and in high-dimensional optimization in general. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.04113 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-04T21:35:49.517Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).