Metraipolis › archive › dc_fa161a443802
How Researchers Use and Verify AI Coding Assistants: Tasks and Validation Practices in Scientific Programming — arXiv:2609.22049
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.22049
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-10T01:44:16.669Z
- SHA-256 of the archived text
975bd5999fc304b2b0ecfe7a4aa13f9188f9f897193efb384d4bc89870a86a4f- Stable URL of this page
https://metraipolis.com/documento/dc_fa161a443802
How to cite
How Researchers Use and Verify AI Coding Assistants: Tasks and Validation Practices in Scientific Programming — arXiv:2609.22049 — arXiv (en), https://arxiv.org/abs/2609.22049 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_fa161a443802 (Metraipolis archive dc_fa161a443802, sha256 975bd5999fc304b2b0ecfe7a4aa13f9188f9f897193efb384d4bc89870a86a4f)
BibTeX
@misc{dcfa161a443802,
title = {How Researchers Use and Verify AI Coding Assistants: Tasks and Validation Practices in Scientific Programming — arXiv:2609.22049},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.22049},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_fa161a443802; sha256 975bd5999fc304b2b0ecfe7a4aa13f9188f9f897193efb384d4bc89870a86a4f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.22049. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Generative AI has entered research programming, yet there is little evidence about which tasks researchers hand to it or how they decide whether its code is correct. We draw on 527 free-text responses to a 2025 survey of researchers who write code, most of them at U.S. universities. In each response, a researcher recounts a single task from their own work, the way they used an AI tool for it, and what they did to assess the result. We coded the task and the evaluation strategies reported, and related both to programming experience, research area, and confidence ratings. Use was concentrated in five tasks: data handling, visualization, debugging, mathematical/scientific computing, and statistical analysis. Evaluation was informal and individual. Over half of accounts described running the generated code, while automated tests and review by another person were rare. Use cases and evaluation strategies varied little with programming experience, but confidence did: Less experienced programmers trusted the AI more than themselves, and experienced programmers the reverse. Evaluation confidence was not associated with the strategies reported. Its strongest correlates were confidence in the tool and in oneself. Validating AI contributions to scientific code rested largely on individual judgment, outside shared infrastructure for testing or review. Interfaces could support task-appropriate evaluation rather than leave it to the user. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-21 in cs.HC). Categorie arXiv: Software Engineering (cs.SE) ; Human-Computer Interaction (cs.HC). Pagina del lavoro: https://arxiv.org/abs/2609.22049 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-10T01:13:57.235Z dalla pagina https://arxiv.org/catchup/cs.HC/2026-09-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).