Metraipolis › archive › dc_e7368fc86998
How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.35376
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T21:53:42.707Z
- SHA-256 of the archived text
4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe- Stable URL of this page
https://metraipolis.com/documento/dc_e7368fc86998
How to cite
How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376 — arXiv (en), https://arxiv.org/abs/2609.35376 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e7368fc86998 (Metraipolis archive dc_e7368fc86998, sha256 4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe)
BibTeX
@misc{dce7368fc86998,
title = {How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.35376},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e7368fc86998; sha256 4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.35376. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
While recent studies have explored human behavior and preference simulation using large language models (LLMs), it remains unclear how well LLMs can simulate subjective evaluations from real learners in educational settings. We investigate this question using real learner evaluation data on feedback for high-school biology questions at both the group and individual levels. We compare performance with and without learner-specific information, such as personality traits and evaluation examples, across six models. Our results show that LLMs still have a limited ability to simulate learner evaluations. Providing learner profiles and examples improves score calibration and individual-level simulation, but more often fails to improve group-level consistency. These findings highlight the need to investigate which learner information and adaptation strategies are effective for learner preference simulation. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.35376 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T21:27:08.684Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).