Metraipolis › archive › dc_f9482abb3c24

Accelerating Accurate Assignment Authoring Using Solution-Generated Autograders — arXiv:2608.06572

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.06572
License (as archived)
CC0-1.0
Archived
2026-10-19T09:49:27.688Z
SHA-256 of the archived text
88b544b8fc008967582a1e2a3d7ff14e99b3e49767ab05f22fd341e8b8bbfe62
Stable URL of this page
https://metraipolis.com/documento/dc_f9482abb3c24

How to cite

Accelerating Accurate Assignment Authoring Using Solution-Generated Autograders — arXiv:2608.06572 — arXiv (en), https://arxiv.org/abs/2608.06572 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f9482abb3c24 (Metraipolis archive dc_f9482abb3c24, sha256 88b544b8fc008967582a1e2a3d7ff14e99b3e49767ab05f22fd341e8b8bbfe62)
BibTeX
@misc{dcf9482abb3c24,
  title = {Accelerating Accurate Assignment Authoring Using Solution-Generated Autograders — arXiv:2608.06572},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.06572},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f9482abb3c24; sha256 88b544b8fc008967582a1e2a3d7ff14e99b3e49767ab05f22fd341e8b8bbfe62},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.06572. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Students learning to program benefit from access to large numbers of practice problems. Autograders are commonly used to support programming questions by providing quick feedback on submissions. But authoring accurate autograders remains challenging. Autograders are frequently created by enumerating test cases--a tedious process that can produce inaccurate autograders that fail to correctly classify submissions. When authoring accurate autograders is slow, it is difficult to create large banks of practice problems to support beginning programmers. We present solution-generated autograding: a faster, more accurate, and more enjoyable way to create autograders. Our approach leverages a key difference between software testing and autograding: The question author can provide a solution. By starting with a solution, we can eliminate the need to manually enumerate test cases, validate the autograder's accuracy, and evaluate other aspects of submission code quality beyond behavioral correctness. We describe Questioner, an implementation of solution-generated autograding for Java and Kotlin, and share experiences from four years using Questioner to support a large CS1 course: authoring nearly 800 programming questions used by thousands of students to evaluate millions of submissions.

Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-08-10 in cs.CY).
Categorie arXiv: Computers and Society (cs.CY) ; Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2608.06572 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T09:48:35.559Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-08-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).