Metraipolis › archive › dc_7ba94e73be57
Africa-Papers: A 10-Billion-Token Multi-Domain Academic Corpus for African Foundation Language Models — arXiv:2610.28173
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.28173
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-21T07:08:17.113Z
- SHA-256 of the archived text
42f25aec914aa1561b117d846dcae55f8639f2dce83a025c4f5edb3d8ab6cfdc- Stable URL of this page
https://metraipolis.com/documento/dc_7ba94e73be57
How to cite
Africa-Papers: A 10-Billion-Token Multi-Domain Academic Corpus for African Foundation Language Models — arXiv:2610.28173 — arXiv (en), https://arxiv.org/abs/2610.28173 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7ba94e73be57 (Metraipolis archive dc_7ba94e73be57, sha256 42f25aec914aa1561b117d846dcae55f8639f2dce83a025c4f5edb3d8ab6cfdc)
BibTeX
@misc{dc7ba94e73be57,
title = {Africa-Papers: A 10-Billion-Token Multi-Domain Academic Corpus for African Foundation Language Models — arXiv:2610.28173},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.28173},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7ba94e73be57; sha256 42f25aec914aa1561b117d846dcae55f8639f2dce83a025c4f5edb3d8ab6cfdc},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.28173. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large Language Models (LLMs) depend fundamentally on the diversity, depth, and factual rigor of their pre-training corpora. However, contemporary foundational pre-training datasets (such as The Pile, S2ORC, and Dolma) exhibit a severe structural omission: African scientific, medical, legal, and agricultural scholarship constitutes less than 0.5% of global pre-training tokens. Consequently, state-of-the-art models suffer from systematic failure modes when reasoning about tropical epidemiology, localized smallholder agro-ecologies, regional economic governance, and indigenous linguistic structures. To resolve this representation deficit and advance African intellectual sovereignty in artificial intelligence, we introduce Africa-Papers, the largest curated multi-domain Pan-African academic pre-training corpus to date. Comprising over 844,807 full-text papers spanning 10.15 billion tokens across 879 Parquet shards, Africa-Papers unifies four primary scientific streams: (1) continental peer-reviewed journals indexed in DOAJ across 31 African nations, (2) the CGIAR CGSpace agricultural repository, (3) African-authored and African-focused STEM/AI preprints on arXiv, and (4) open-access international publications by scholars affiliated with African institutions indexed via OpenAlex. The entire corpus is processed into layout-aware, clean Markdown preserving section hierarchies, mathematical equations, and tabular data, accompanied by exact BPE token counts and a standardized 8-domain taxonomy. We release Africa-Papers openly on the Hugging Face Hub under the AfriSpeech organization to accelerate continual pre-training and domain evaluation for foundation models globally. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.28173 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-21T07:05:43.625Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).