Metraipolis › archive › dc_6ea804f46da1
The Normalization of Deviance in AI Development — arXiv:2609.05749
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.05749
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T15:40:36.750Z
- SHA-256 of the archived text
d00b29e5db6550051492f9309efcf67f64fa53c4b6f135fde3b94e68ed5fcf0c- Stable URL of this page
https://metraipolis.com/documento/dc_6ea804f46da1
How to cite
The Normalization of Deviance in AI Development — arXiv:2609.05749 — arXiv (en), https://arxiv.org/abs/2609.05749 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6ea804f46da1 (Metraipolis archive dc_6ea804f46da1, sha256 d00b29e5db6550051492f9309efcf67f64fa53c4b6f135fde3b94e68ed5fcf0c)
BibTeX
@misc{dc6ea804f46da1,
title = {The Normalization of Deviance in AI Development — arXiv:2609.05749},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.05749},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6ea804f46da1; sha256 d00b29e5db6550051492f9309efcf67f64fa53c4b6f135fde3b94e68ed5fcf0c},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.05749. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Work on the risks of artificial intelligence has focused predominantly on capability risk: the danger that systems become too powerful, too autonomous, or too misaligned with human values. Far less attention has been paid to the organizational level---to whether the institutions building these systems are themselves predisposed to drift toward failure. This paper argues that they are. Regardless of how capable AI systems become, the organizations building them face the same structural dynamics that preceded past major technological disasters. Drawing on case studies of the Space Shuttle Challenger, the Three Mile Island accident, and the Boeing 737 MAX crashes, this paper identifies the common structural mechanisms preceding each failure and maps them onto contemporary AI development. The findings suggest that existing safety infrastructure may provide less protection than it appears, as organizations can complete safety processes in full compliance and still produce catastrophic outcomes. The pre-disaster period of AI development is still underway; the purpose of this paper is to make these dynamics legible while they can still be interrupted. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-09-09 in cs.ET). Categorie arXiv: Artificial Intelligence (cs.AI) ; Emerging Technologies (cs.ET); Systems and Control (eess.SY). Pagina del lavoro: https://arxiv.org/abs/2609.05749 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T15:31:57.848Z dalla pagina https://arxiv.org/catchup/cs.ET/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).