Metraipolis › archive › dc_e9f264e48b7b

Using LLMs to Detect Growth in Computational Thinking in Introductory Physics — arXiv:2608.06200

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.06200
License (as archived)
CC0-1.0
Archived
2026-10-31T11:03:06.912Z
SHA-256 of the archived text
d660602b6c41f193f2e62dab3d677e61ad3080674267a1b07b011c836a17a686
Stable URL of this page
https://metraipolis.com/documento/dc_e9f264e48b7b

How to cite

Using LLMs to Detect Growth in Computational Thinking in Introductory Physics — arXiv:2608.06200 — arXiv (en), https://arxiv.org/abs/2608.06200 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e9f264e48b7b (Metraipolis archive dc_e9f264e48b7b, sha256 d660602b6c41f193f2e62dab3d677e61ad3080674267a1b07b011c836a17a686)
BibTeX
@misc{dce9f264e48b7b,
  title = {Using LLMs to Detect Growth in Computational Thinking in Introductory Physics — arXiv:2608.06200},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.06200},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e9f264e48b7b; sha256 d660602b6c41f193f2e62dab3d677e61ad3080674267a1b07b011c836a17a686},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.06200. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

As computation becomes more central to physics education, creating scalable methods to assess authentic computational thinking (CT) in students remains a critical challenge. While student-written responses capture nuanced reasoning, they are difficult to evaluate at scale. In this study, we investigated the use of Large Language Models (LLMs) to analyze students' written explanations of computational physics problems on a pre- and post- semester survey. By first establishing a human-coded baseline, grounded in CT literature, we identified significant growth in Data Practices and Computational Problem-Solving Practices. When given the same responses, an LLM successfully mirrored the human evaluations and scaled up the detection of these key trends across a large dataset. Notably, both human raters and the LLM struggled to reliably evaluate more complex constructs such as Systems Thinking. Overall, this study demonstrates that LLMs offer a viable method to scale the evaluation of students' CT in large-enrollment physics courses

Tema degli esploratori: ricerca e scienza aperta (retro-catalogo arXiv: annunci del 2026-08-07 in physics.ed-ph).
Categorie arXiv: Physics Education (physics.ed-ph).
Pagina del lavoro: https://arxiv.org/abs/2608.06200 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-31T10:52:21.666Z dalla pagina https://arxiv.org/catchup/physics.ed-ph/2026-08-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).