Metraipolis › archive › dc_862fca0a8817

StudentBench: AI and human tutoring yield equivalent GRE learning gains — arXiv:2609.28470

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.28470
License (as archived)
CC0-1.0
Archived
2026-10-08T09:11:43.715Z
SHA-256 of the archived text
665f2f07ef3fef195c05c9eea1fc74c99cb8678bd56864f573810a6c437214fd
Stable URL of this page
https://metraipolis.com/documento/dc_862fca0a8817

How to cite

StudentBench: AI and human tutoring yield equivalent GRE learning gains — arXiv:2609.28470 — arXiv (en), https://arxiv.org/abs/2609.28470 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_862fca0a8817 (Metraipolis archive dc_862fca0a8817, sha256 665f2f07ef3fef195c05c9eea1fc74c99cb8678bd56864f573810a6c437214fd)
BibTeX
@misc{dc862fca0a8817,
  title = {StudentBench: AI and human tutoring yield equivalent GRE learning gains — arXiv:2609.28470},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.28470},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_862fca0a8817; sha256 665f2f07ef3fef195c05c9eea1fc74c99cb8678bd56864f573810a6c437214fd},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.28470. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Artificial intelligence offers an unprecedented opportunity to augment human capabilities, yet progress at the frontier has focused primarily on advancing model capabilities. We introduce StudentBench, a suite of AI teaching evaluations and a public platform that enables large-scale data collection with over 175,000 student-AI messages to study whether large language models (LLMs) produce learning gains equivalent to human tutoring. Using StudentBench, we measured learning gains on Quantitative and Verbal GRE questions across 2,383 human participants receiving AI tutoring, human tutoring, or no tutoring. We establish that AI tutoring is statistically equivalent to expert human tutoring for GRE learning gains (p = .015), and in five of the seven GRE domains, the best performing AI tutor surpassed the human tutor, on average. In a second study, expert human tutors compared LLM-generated lesson plans and practice problems through 2,028 pairwise rubric evaluations. Together, the two studies clearly separate AI tutors across: (1) lesson planning, (2) practice-problem creation, (3) conversational pedagogy, (4) cost, and (5) engagement. Surprisingly, one AI tutor achieved learning gains equivalent to human tutoring (p = .044) at 918 times lower cost (USD 0.0052 for AI versus USD 4.81 for human, per percentage point gained). For Quantitative GRE sessions, faster AI replies correlated with more student messages, more messages with more correct practice, and more correct practice with larger learning gains (all p < .002). To support future research, we open-source the de-identified data collected in our studies.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-24 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computers and Society (cs.CY).
Pagina del lavoro: https://arxiv.org/abs/2609.28470 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T08:13:26.560Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).