Metraipolis › archive › dc_33bcaf1adee7

Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling — arXiv:2609.03178

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.03178
License (as archived)
CC0-1.0
Archived
2026-10-17T01:57:53.909Z
SHA-256 of the archived text
efc8bc38c713388d827e68f4cf54663a9b800bb44bdc48256a9243c672b72ce4
Stable URL of this page
https://metraipolis.com/documento/dc_33bcaf1adee7

How to cite

Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling — arXiv:2609.03178 — arXiv (en), https://arxiv.org/abs/2609.03178 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_33bcaf1adee7 (Metraipolis archive dc_33bcaf1adee7, sha256 efc8bc38c713388d827e68f4cf54663a9b800bb44bdc48256a9243c672b72ce4)
BibTeX
@misc{dc33bcaf1adee7,
  title = {Open Problems in AI Risk Modeling: Insights from a Workshop on the Technical Foundations of AI Risk Modeling — arXiv:2609.03178},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.03178},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_33bcaf1adee7; sha256 efc8bc38c713388d827e68f4cf54663a9b800bb44bdc48256a9243c672b72ce4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.03178. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We investigate the design of robust risk models to assess societal risks posed by advanced AI systems, an emerging area in AI governance. Many regulatory proposals increasingly require systemic risk assessment, but in the absence of rigorous quantitative methods, the question remains what state of the art risk modeling should look like in practice. We identify the key methodological and institutional challenges that currently limit the adoption of risk modeling. We review five research traditions that inform this problem: probabilistic risk assessment, catastrophic AI risk analysis, cybersecurity risk quantification, Bayesian causal inference, and threshold-based governance. We compare two leading proposals, scenario-based risk estimation and Bayesian network-based threshold setting. Drawing on a workshop with 22 experts and subsequent analysis, we identify a structured agenda of open questions concerning model structure, scope, evidence integration, validation, and governance. We close by outlining priorities for progress, arguing that it will depend on integrating quantitative modeling with independent evaluation, transparent and tiered disclosure, and institutions capable of maintaining and updating risk models over time.

Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-09-04 in cs.CY).
Categorie arXiv: Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2609.03178 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T01:12:46.503Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-09-04?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).