Metraipolis › archive › dc_0d7381dbdfa8
Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents — arXiv:2608.08852
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.08852
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:49:35.392Z
- SHA-256 of the archived text
3ebb98a2e9e674405be4df30c291b343ba44b70aa1de7c07cebc79951e8b76ed- Stable URL of this page
https://metraipolis.com/documento/dc_0d7381dbdfa8
How to cite
Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents — arXiv:2608.08852 — arXiv (en), https://arxiv.org/abs/2608.08852 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0d7381dbdfa8 (Metraipolis archive dc_0d7381dbdfa8, sha256 3ebb98a2e9e674405be4df30c291b343ba44b70aa1de7c07cebc79951e8b76ed)
BibTeX
@misc{dc0d7381dbdfa8,
title = {Findings of the First Teaching Monster Challenge: A Benchmark of Pedagogical Content Knowledge in AI Agents — arXiv:2608.08852},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.08852},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0d7381dbdfa8; sha256 3ebb98a2e9e674405be4df30c291b343ba44b70aa1de7c07cebc79951e8b76ed},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.08852. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
AI agents can now solve problems, answer like subject experts, and generate long-form multimodal content. However, whether they can adapt a lesson to fit a specified learner, which education calls Pedagogical Content Knowledge (PCK), has not been benchmarked. To measure it, we introduce the Teaching Monster Challenge, the first instructional video generation benchmark to treat the learner persona as an explicit evaluation criterion. Each system is given a topic and a learner persona and must generate a complete instructional video. Every video is screened by an LLM-judge, ranked by crowd pairwise voting, and finalized by an expert panel. The first edition shows that today's systems handle the content well but are far weaker at presenting it and adapting it to the learner. The same process exposes a limit of automatic judging. The LLM-judge separates a clear low-performing tail but ranks the strongest systems poorly. The strongest systems receive nearly identical scores from the judge, so its ranking of them does not match human preference. Progress therefore requires not only better teaching systems but also better automatic judges, and we release the benchmark, rubric, and human judgments as a testbed for both. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-11 in cs.MA). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA). Pagina del lavoro: https://arxiv.org/abs/2608.08852 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T06:45:31.715Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).