Metraipolis › archive › dc_134f013d794e

FIRSTPASS: A Multi-Domain, Multi-Round Peer Review Dataset Grounded in Real Editorial Outcomes — arXiv:2608.26129

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.26129
License (as archived)
CC0-1.0
Archived
2026-10-17T14:24:00.644Z
SHA-256 of the archived text
3aac0cb65a6d19df7e40da155ed44900aead8520d49782034d6800596899e9c4
Stable URL of this page
https://metraipolis.com/documento/dc_134f013d794e

How to cite

FIRSTPASS: A Multi-Domain, Multi-Round Peer Review Dataset Grounded in Real Editorial Outcomes — arXiv:2608.26129 — arXiv (en), https://arxiv.org/abs/2608.26129 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_134f013d794e (Metraipolis archive dc_134f013d794e, sha256 3aac0cb65a6d19df7e40da155ed44900aead8520d49782034d6800596899e9c4)
BibTeX
@misc{dc134f013d794e,
  title = {FIRSTPASS: A Multi-Domain, Multi-Round Peer Review Dataset Grounded in Real Editorial Outcomes — arXiv:2608.26129},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.26129},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_134f013d794e; sha256 3aac0cb65a6d19df7e40da155ed44900aead8520d49782034d6800596899e9c4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.26129. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Scientific peer review datasets have trained AI systems exclusively on Computer Science and Machine Learning venues, producing models that critique ablation studies yet have never seen a biology reviewer demand contamination controls or a chemist question Nuclear Magnetic Resonance (NMR) spectral assignments. We introduce FIRSTPASS, the first large-scale peer review dataset built on complete multi-round editorial dialogues from a multidisciplinary high-impact journal. Curated from Nature Communications mandatory transparent peer review (instituted November 2022), FIRSTPASS comprises 3,668 records spanning five scientific domains (biology, chemistry, neuroscience, physics, and earth science), capturing the full iterative structure of scientific validation: initial referee reports, author point-by-point responses, and updated reviewer assessments. Each record carries an outcome label derived directly from editorial decisions (STANDARD for two-round review; EXTENDED for three or more rounds), providing ground truth absent in all prior corpora. An automated audit confirms 100% content integrity. Expert reviews average 2,155 words, substantially denser than conference venue reviews. All data, parsing pipelines, and evaluation scripts are released to enable reproducible benchmarking of AI scientific judgment across disciplines.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2608.26129 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T13:16:53.585Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).