Metraipolis › archive › dc_154fc53b9514

Interpreting Classical Readability Formulae as Surprisal — arXiv:2611.01359

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.01359
License (as archived)
CC0-1.0
Archived
2026-11-03T18:22:47.383Z
SHA-256 of the archived text
6b348ca85139fd77b1088605304e499665f1cdf473a7219fe18666924a6c8224
Stable URL of this page
https://metraipolis.com/documento/dc_154fc53b9514

How to cite

Interpreting Classical Readability Formulae as Surprisal — arXiv:2611.01359 — arXiv (en), https://arxiv.org/abs/2611.01359 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_154fc53b9514 (Metraipolis archive dc_154fc53b9514, sha256 6b348ca85139fd77b1088605304e499665f1cdf473a7219fe18666924a6c8224)
BibTeX
@misc{dc154fc53b9514,
  title = {Interpreting Classical Readability Formulae as Surprisal — arXiv:2611.01359},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.01359},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_154fc53b9514; sha256 6b348ca85139fd77b1088605304e499665f1cdf473a7219fe18666924a6c8224},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.01359. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Surprisal correlates closely with reading time and is widely used in the cognitive science of reading as a measure of processing difficulty. Classical readability formulae such as the Flesch-Kincaid Grade Level, which scores a text by the US school grade expected to read it, are the most widely used practical measures of text difficulty, but their coefficients are unitless regression constants and have never been related to surprisal. We theoretically show that these coefficients can be interpreted as surprisal: every formula of the classical additive shape is a sum of per-word and per-sentence cross-entropies under a memoryless model, and once that model is tied to the language through Zipf's law and the formula is read as its linearisation at a reference text, each coefficient factorises into a scale in grades per nat, a Zipf slope and a reference sentence length. A grade thereby becomes a quantity in surprisal. Because the formula outputs grades and children's vocabulary has been measured by grade, the interpretation recovers the vocabulary growth the formula implicitly assumes and lets it be checked against development: holding sentence length fixed, the word coefficient of the Flesch-Kincaid formula converts to 0.18 nat of unigram surprisal per word per grade (0.15 to 0.19 across the regression-derived formulae), and normative root-word vocabulary growth (Biemiller and Slonim, 2001), converted through Zipf's law, gives 0.16 nat per year at the frontier of the known vocabulary. The word coefficient is one year of vocabulary growth, and the grade is a vocabulary scale. The identification also yields a diagnostic (the sentence-length terms are not those of a memoryless surprisal) and extends to a Japanese formula.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno).
Categorie arXiv: Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2611.01359 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:10:07.922Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).