Metraipolis › archive › dc_682a02588afc

Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming — arXiv:2609.29995

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.29995
License (as archived)
CC0-1.0
Archived
2026-10-08T04:27:56.490Z
SHA-256 of the archived text
86af550a0ae8d6df4f94843e90cbb5faa349599231b945be6f9c3f12789808a1
Stable URL of this page
https://metraipolis.com/documento/dc_682a02588afc

How to cite

Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming — arXiv:2609.29995 — arXiv (en), https://arxiv.org/abs/2609.29995 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_682a02588afc (Metraipolis archive dc_682a02588afc, sha256 86af550a0ae8d6df4f94843e90cbb5faa349599231b945be6f9c3f12789808a1)
BibTeX
@misc{dc682a02588afc,
  title = {Guardrails or Roadblocks? Effects of Pedagogical Style and Context Awareness in AI Teaching Assistants for Programming — arXiv:2609.29995},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.29995},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_682a02588afc; sha256 86af550a0ae8d6df4f94843e90cbb5faa349599231b945be6f9c3f12789808a1},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.29995. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

AI teaching assistants (AI TAs) backed by large language models (LLMs) and pedagogical guardrails are increasingly being integrated into programming courses, providing students with scalable access to hints, conceptual explanations, and code-level feedback. However, guardrails may also create friction. If students feel that the support provided is overly restrictive or poorly contextualized to their current progress, they may bypass approved tools for general-purpose LLMs. To investigate how AI TA design affects students' learning experiences, we conducted a randomized controlled trial with 132 students in an introductory programming course. Students completed three tasks related to code-writing and debugging and were randomly assigned to one of four AI TAs varied across two dimensions: pedagogical guidance style (Socratic vs. Direct instruction) and context awareness (no context vs. full context of the problem and student solution). We examined students' perceptions, interaction behaviors, and evidence of post-task comprehension. Students rated the Socratic AI TA with full context least favorably, reporting significantly lower perceived support for task completion. Descriptively, this condition also showed the highest observed interaction stress, the highest rate of external LLM use, and the lowest proportion of post-task explanations demonstrating full comprehension, though these differences were not statistically significant. These findings suggest that guardrailed AI TAs are not automatically better for learning. Instead, their effectiveness depends on how pedagogical guidance and contextual awareness are balanced in ways that students experience as useful, supportive, and worth continuing to use.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-25 in cs.AI).
Categorie arXiv: Human-Computer Interaction (cs.HC) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.29995 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T03:50:58.208Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).