Metraipolis › archive › dc_cfa4a2a3d30a
Assessing Readability with LLMs: The Role of Reasoning and Few-Shot Prompting — arXiv:2609.24650
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.24650
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T06:50:12.368Z
- SHA-256 of the archived text
850ce0a777fedd4f37609ed2c9693abb1c8783fa74edf4f4117ce5f54301663f- Stable URL of this page
https://metraipolis.com/documento/dc_cfa4a2a3d30a
How to cite
Assessing Readability with LLMs: The Role of Reasoning and Few-Shot Prompting — arXiv:2609.24650 — arXiv (en), https://arxiv.org/abs/2609.24650 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cfa4a2a3d30a (Metraipolis archive dc_cfa4a2a3d30a, sha256 850ce0a777fedd4f37609ed2c9693abb1c8783fa74edf4f4117ce5f54301663f)
BibTeX
@misc{dccfa4a2a3d30a,
title = {Assessing Readability with LLMs: The Role of Reasoning and Few-Shot Prompting — arXiv:2609.24650},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.24650},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cfa4a2a3d30a; sha256 850ce0a777fedd4f37609ed2c9693abb1c8783fa74edf4f4117ce5f54301663f},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.24650. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Readability assessment is essential for tailoring texts to intended audiences across educational, healthcare, and information retrieval domains. However, traditional readability formulas struggle to generalize across genres and languages, while supervised machine learning models rely on scarce, domain-specific annotated corpora, limiting their applicability--particularly for less-resourced languages. Large Language Models (LLMs) offer a highly scalable, multilingual alternative that requires no task-specific training, yet the impact of advanced prompting strategies on their performance remains underexplored. In this paper, we conduct a systematic benchmark of diverse open-source LLMs for multilingual readability assessment, focusing on the prediction of discrete readability levels required by educational frameworks. In addition to English, we evaluate our approach on a less-resourced language, Slovenian, to establish whether LLMs remain effective in low-resource settings. Specifically, we investigate the influence of explicit reasoning, demonstrating that Chain-of-Thought (CoT) prompting and reasoning-oriented models yield significant improvements over direct answering. Furthermore, our exploration of few-shot in-context learning reveals that providing just one labelled example per category (1-shot) substantially enhances prediction quality compared to zero-shot settings, with additional examples offering diminishing returns. By comprehensively comparing these approaches against traditional unsupervised metrics and state-of-the-art supervised baselines, we establish the viability of out-of-the-box LLMs as robust, cross-lingual readability assessors. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-22 in cs.CL). Categorie arXiv: Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.24650 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T06:48:45.059Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-22?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).