Metraipolis › archive › dc_415a7d14485d
DISCERN: Can AI Agents Work Like Scientists and Guide Discovery? — arXiv:2609.33357
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.33357
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T20:56:43.837Z
- SHA-256 of the archived text
8ad20f64663d45e76f98ba5f99d7164c5adc5b994482ad234b3b4be07ed11aad- Stable URL of this page
https://metraipolis.com/documento/dc_415a7d14485d
How to cite
DISCERN: Can AI Agents Work Like Scientists and Guide Discovery? — arXiv:2609.33357 — arXiv (en), https://arxiv.org/abs/2609.33357 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_415a7d14485d (Metraipolis archive dc_415a7d14485d, sha256 8ad20f64663d45e76f98ba5f99d7164c5adc5b994482ad234b3b4be07ed11aad)
BibTeX
@misc{dc415a7d14485d,
title = {DISCERN: Can AI Agents Work Like Scientists and Guide Discovery? — arXiv:2609.33357},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.33357},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_415a7d14485d; sha256 8ad20f64663d45e76f98ba5f99d7164c5adc5b994482ad234b3b4be07ed11aad},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33357. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Reliable automated research requires agents to vet data, verify analyses, and generate hypotheses grounded in trustworthy evidence, potentially reducing routine scientific workload while allowing scientists to focus on interpretation and discovery. Existing benchmarks often only assess analytical task completion or hypothesis generation separately rather than testing whether reliable evidence supports valid and novel claims. We introduce DISCERN (Data Integrity and Scientific Capability: Evidence, Reasoning, and Novelty), a controlled benchmark on real, publicly available datasets that evaluates three key levels of an automated research workflow. The first two levels test data integrity and analysis verification under confounds and tool traps, while the third tests hypothesis generation and revision under adversarial review, including counterfactual cases in which evidence consistent with real data and documented scientific phenomena conflicts with established expectations, motivating alternative explanations and testable hypotheses. Across 203 tasks, eight life-science tracks, and eight models, DISCERN shows that strong aggregate performance can mask level-specific weaknesses. Agents earn perfect scores in only 60.8% of Level 1, 34.2% of Level 2, and 0.6% of Level 3 evaluations, with penalties attributed to rejection of sound data, failure to carry recognized limitations into conclusions, and wide variation in hypothesis production. Cross-track rankings by token and code use are substantially more stable than rankings by evidence judgment, suggesting greater consistency in computational effort than in evidence-based reasoning. These profiles identify opportunities for supervised scientific assistance, but current agents do not yet demonstrate reliable autonomous analysis or discovery. Code and data: this https URL Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.33357 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T20:29:01.234Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).