Metraipolis › archive › dc_bca236bef18d

greCAPTCHA: Assessing Understanding as Evidence of Research Authorship Under Generative AI — arXiv:2609.20481

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.20481
License (as archived)
CC0-1.0
Archived
2026-10-10T03:24:19.585Z
SHA-256 of the archived text
4aa6af2e5b15debbd5a0428752a844320d2d7a8d51cf93a5917d69b0ee1a832c
Stable URL of this page
https://metraipolis.com/documento/dc_bca236bef18d

How to cite

greCAPTCHA: Assessing Understanding as Evidence of Research Authorship Under Generative AI — arXiv:2609.20481 — arXiv (en), https://arxiv.org/abs/2609.20481 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_bca236bef18d (Metraipolis archive dc_bca236bef18d, sha256 4aa6af2e5b15debbd5a0428752a844320d2d7a8d51cf93a5917d69b0ee1a832c)
BibTeX
@misc{dcbca236bef18d,
  title = {greCAPTCHA: Assessing Understanding as Evidence of Research Authorship Under Generative AI — arXiv:2609.20481},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.20481},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_bca236bef18d; sha256 4aa6af2e5b15debbd5a0428752a844320d2d7a8d51cf93a5917d69b0ee1a832c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.20481. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Conferences, journals, funders, schools, and universities are struggling with a surge of potentially AI-generated submissions from ostensibly human authors, who may not have exercised sufficient human oversight for their manuscripts. In turn, institutions evaluating submissions can no longer reliably credit expertise based solely on authors' names on submitted work. To address this problem, we propose greCAPTCHA, a proctored assessment approach that measures authors' understanding of research manuscripts via the construct of capacity to verify, which we define as the knowledge and reasoning required to critically assess the contents underlying one's contributions to a manuscript. greCAPTCHA generates questions assessing multiple levels of understanding and provides an evaluative report based on authors' responses. Using a prototype implementation, we conduct a user study and semi-structured interviews with $31$ researchers to evaluate greCAPTCHA. Its automated scores predict which papers were or were not authored by study participants with an AUC of $0.90$. Participants reported positive overall experiences with the system and remarked on the appropriate construct validity for author understanding, while also suggesting important changes to be made before deployment. Our results provide initial evidence that greCAPTCHA can assess manuscript-specific understanding under proctored conditions.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.AI).
Categorie arXiv: Digital Libraries (cs.DL) ; Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2609.20481 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T03:04:13.963Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).