Metraipolis › archive › dc_e7368fc86998

How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.35376
License (as archived)
CC0-1.0
Archived
2026-10-07T21:53:42.707Z
SHA-256 of the archived text
4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe
Stable URL of this page
https://metraipolis.com/documento/dc_e7368fc86998

How to cite

How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376 — arXiv (en), https://arxiv.org/abs/2609.35376 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e7368fc86998 (Metraipolis archive dc_e7368fc86998, sha256 4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe)
BibTeX
@misc{dce7368fc86998,
  title = {How Well Can LLMs Simulate Real Learner Evaluations of Educational Feedback? — arXiv:2609.35376},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.35376},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e7368fc86998; sha256 4c4b04d47912ab3699c5c0eb183eda7bd4b41e4f4e4945921353edb968483dfe},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.35376. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

While recent studies have explored human behavior and preference simulation using large language models (LLMs), it remains unclear how well LLMs can simulate subjective evaluations from real learners in educational settings. We investigate this question using real learner evaluation data on feedback for high-school biology questions at both the group and individual levels. We compare performance with and without learner-specific information, such as personality traits and evaluation examples, across six models. Our results show that LLMs still have a limited ability to simulate learner evaluations. Providing learner profiles and examples improves score calibration and individual-level simulation, but more often fails to improve group-level consistency. These findings highlight the need to investigate which learner information and adaptation strategies are effective for learner preference simulation.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.35376 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T21:27:08.684Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).