Metraipolis › archive › dc_6f390d28bf53
Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch — arXiv:2610.10592
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.10592
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T06:04:00.406Z
- SHA-256 of the archived text
d35763a62a81a5c7b7ab0dbcd0c07995d2e30dd909948c8f5d71f56be0be0969- Stable URL of this page
https://metraipolis.com/documento/dc_6f390d28bf53
How to cite
Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch — arXiv:2610.10592 — arXiv (en), https://arxiv.org/abs/2610.10592 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_6f390d28bf53 (Metraipolis archive dc_6f390d28bf53, sha256 d35763a62a81a5c7b7ab0dbcd0c07995d2e30dd909948c8f5d71f56be0be0969)
BibTeX
@misc{dc6f390d28bf53,
title = {Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch — arXiv:2610.10592},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.10592},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_6f390d28bf53; sha256 d35763a62a81a5c7b7ab0dbcd0c07995d2e30dd909948c8f5d71f56be0be0969},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.10592. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Historical Polish is well documented as a language but annotated in machine-readable form only to about a million words for the period this paper covers; the rest sits behind optical character recognition of variable quality. We present Wieszcz-XIX, a corpus of 6.75 billion tokens (about 3.1 billion words) in 294,369 documents, most of them periodical issues, of Polish published from 1800 to 1918, assembled from Wolne Lektury and the Internet Archive by a pipeline that filters, deduplicates, audits for post-1918 leakage and splits at the document level. It is over three orders of magnitude larger than the annotated corpus of the same period, and we quantify its defects: recognition corruption against a false-positive floor, near-identical duplication, which is removed, and post-1918 leakage, which is excluded from the training corpus itself down to a known residue of 0.04 to 0.38% of its bytes, found in the transcribed source, so the published corpus is the trained one document for document. On a hand-corrected sample the character error rate is 0.68% where the text is legible, and 45% of the sampled passages cannot be corrected. On it we train a ladder of decoder-only models from 47M to 349M parameters from scratch, and measure their temporal boundedness. Against two modern Polish base models, one far larger, the 349M shows a crossover, as does the 107M against the comparator of its size: post-1918 vocabulary costs them about 3.1 bits per byte more than period vocabulary, a gap the comparators do not show, and period vocabulary costs them fewer bits than it costs the comparators. Shown period text, the models keep its spelling and the comparators only partly. Adding parameters gains about twice as much as a second pass over the data. We release the corpus, code and weights. Content warning: the models reproduce period prejudice, including antisemitic statements. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.CL, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Digital Libraries (cs.DL). Pagina del lavoro: https://arxiv.org/abs/2610.10592 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T05:47:15.089Z dalla pagina https://arxiv.org/list/cs.CL/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).