Metraipolis › archive › dc_da72c0b43570
ASI-Bench: At the Dawn of Artificial Superintelligence — arXiv:2608.17271
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.17271
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T14:28:33.828Z
- SHA-256 of the archived text
7a59e387bf3f96c054013d5230e39a340d45b6634330ad2e8a42bd111f018b3e- Stable URL of this page
https://metraipolis.com/documento/dc_da72c0b43570
How to cite
ASI-Bench: At the Dawn of Artificial Superintelligence — arXiv:2608.17271 — arXiv (en), https://arxiv.org/abs/2608.17271 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_da72c0b43570 (Metraipolis archive dc_da72c0b43570, sha256 7a59e387bf3f96c054013d5230e39a340d45b6634330ad2e8a42bd111f018b3e)
BibTeX
@misc{dcda72c0b43570,
title = {ASI-Bench: At the Dawn of Artificial Superintelligence — arXiv:2608.17271},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.17271},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_da72c0b43570; sha256 7a59e387bf3f96c054013d5230e39a340d45b6634330ad2e8a42bd111f018b3e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.17271. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Artificial superintelligence (ASI) requires AI to move beyond mastering existing knowledge toward exploring the unknown, creating new knowledge, and turning new ideas into verifiable results. However, the capabilities of today's AI systems are still largely built on learning, compressing, and applying existing human knowledge. Accordingly, existing benchmarks primarily test whether AI can produce correct answers based on learned knowledge, or whether it can complete tasks under extensive human guidance. We therefore introduce ASI-Bench, the first benchmark to jointly evaluate AI systems' capabilities of innovative exploration and autonomous scientific execution across general research domains, and the first to progressively withdraw human methodological guidance within the same research project to test how far AI can proceed on its own. Built by over 40 experts with the cost of 31,000+ human hours, ASI-Bench contains 60 project-level research tasks across 11 scientific domains and progressively reduces methodological guidance to test whether AI can independently select methods, conduct research, and produce verifiable results. All tasks undergo expert review, AI-assisted auditing, sandbox execution, and scorer validation. Across 18 state-of-the-art agent--model configurations, the average score drops from 50.91 with full methodological guidance to 29.10 with only the method specified and 26.62 when agents must determine the method themselves. This sharp decline shows that current systems remain heavily dependent on human guidance and are still far from autonomously conducting end-to-end, project-level scientific research. ASI-Bench is open to the world. We invite researchers and builders everywhere to contribute new tasks, challenge the limits of today's AI, and help accelerate humanity's collective path toward artificial superintelligence at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-19 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.17271 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T14:27:54.248Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-19?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).