Metraipolis › archive › dc_4438724cd583
Edu-QuRating: Multi-Dimensional Educational Data Curation with Distilled Pairwise Judgements — arXiv:2609.09425
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.09425
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T07:25:24.140Z
- SHA-256 of the archived text
a2a1db471fa8b38c89ea372650ddda9dca2764016d7cdf7c3dc1c6571e2341c2- Stable URL of this page
https://metraipolis.com/documento/dc_4438724cd583
How to cite
Edu-QuRating: Multi-Dimensional Educational Data Curation with Distilled Pairwise Judgements — arXiv:2609.09425 — arXiv (en), https://arxiv.org/abs/2609.09425 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4438724cd583 (Metraipolis archive dc_4438724cd583, sha256 a2a1db471fa8b38c89ea372650ddda9dca2764016d7cdf7c3dc1c6571e2341c2)
BibTeX
@misc{dc4438724cd583,
title = {Edu-QuRating: Multi-Dimensional Educational Data Curation with Distilled Pairwise Judgements — arXiv:2609.09425},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.09425},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4438724cd583; sha256 a2a1db471fa8b38c89ea372650ddda9dca2764016d7cdf7c3dc1c6571e2341c2},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.09425. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Educational data filters have become a practical way to improve language-model pre-training, but most filters treat educational value as a single scalar property. This may be too broad for some applications, especially if the data set already features a high density of educational material. Useful learning material needs to be accurate, engaging, well structured, and appropriate for the intended audience and application (e.g. learner- vs teacher-facing). Following QuRating (Wettig et al. 2024), we introduce Edu-QuRating: a pipeline for multi-dimensional educational data scoring and curation. Edu-QuRating defines education-specific rubrics, uses an LLM judge to label sampled document pairs and distills those pairwise preferences into reusable Edu-QuRaters, which can score individual text chunks on a set of educational criteria. Across two sequence-classification base models and six educational criteria, the best Edu-QuRater recovers held-out GPT-4.1-mini pairwise judgements with mean accuracy 0.917. We then apply the resulting scorers in two applications. First, we investigate the potential of Edu-QuRaters for corpus filtering to improve pretraining of small language models. We scored 322.25M FineWeb-Edu-Fortified documents to obtain a filtered pre-training mixture. In matched single-run pre-training comparisons, models trained with Edu-QuRating-based mixtures reached higher observed aggregate accuracy across nine benchmarks than the FineWeb-Edu baseline, with gains concentrated in particular tasks. Second, we used Edu-QuRater scores as reward terms for GRPO post-training. In held-out pairwise judge evaluations, combining Edu-QuRater and answer-structure rewards produced responses preferred to the Qwen3-4B base model on both pedagogical quality and instruction following. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-10 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.09425 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T07:00:16.307Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-10?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).