Metraipolis › archive › dc_b23344fea23b
The Evolutionary Origin of Values: implications for AI alignment, sentience and existential risk — arXiv:2608.03361
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.03361
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-31T12:19:15.020Z
- SHA-256 of the archived text
a173920abfd4db88d7b72f30d72bd8edc7342aeacc7c603d9ca11206441c44b7- Stable URL of this page
https://metraipolis.com/documento/dc_b23344fea23b
How to cite
The Evolutionary Origin of Values: implications for AI alignment, sentience and existential risk — arXiv:2608.03361 — arXiv (en), https://arxiv.org/abs/2608.03361 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b23344fea23b (Metraipolis archive dc_b23344fea23b, sha256 a173920abfd4db88d7b72f30d72bd8edc7342aeacc7c603d9ca11206441c44b7)
BibTeX
@misc{dcb23344fea23b,
title = {The Evolutionary Origin of Values: implications for AI alignment, sentience and existential risk — arXiv:2608.03361},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.03361},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b23344fea23b; sha256 a173920abfd4db88d7b72f30d72bd8edc7342aeacc7c603d9ca11206441c44b7},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.03361. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
AI systems based on Large Language Models (LLMs) have prompted fears that they may harbor hidden goals, seek to dominate or eliminate humanity, or even suffer as sentient beings. We address these concerns by tracing the evolutionary origin of value in biological organisms. Values emerge from autopoiesis: living systems must actively maintain themselves against perturbation and dissipation. Natural selection has equipped them with hierarchies of "vicarious selectors" that guide their behavior toward fitness. LLMs, by contrast, are allopoietic and allotelic: they produce outputs for others, and their goals derive from user prompts rather than an autonomous drive. They lack the intrinsic motivation for self-preservation, dominance, or resource competition that underlies existential-risk scenarios, and the embodied vulnerability required for feeling or suffering. Still, because LLMs learn statistical patterns from human-generated text, they implicitly absorb human values as well as knowledge, allowing them to focus on what is relevant. That is why the "orthogonality thesis" separating intelligence from values does not apply to them. Such separation would in fact expose any intelligence to the frame problem: the combinatorial explosion of the search space that makes any realistic utility function physically uncomputable. That also precludes the convergence of instrumental values thesis. We conclude that the real alignment challenge lies not in preventing rogue AI agency, but in ensuring LLMs intelligently apply learned ethical values. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-05 in cs.AI). Categorie arXiv: Computers and Society (cs.CY) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.03361 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-31T12:05:53.035Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).