Metraipolis › archive › dc_3e18befdea23
Wazobia Eval: A Benchmark for Nigerian Pidgin Emotion Understanding, Sarcasm Detection, and Cultural Reasoning — arXiv:2608.21369
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.21369
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T07:42:06.722Z
- SHA-256 of the archived text
b5d09ce91b655a233b008b4dce16b80253f3936a173634abde2bd36d3763124d- Stable URL of this page
https://metraipolis.com/documento/dc_3e18befdea23
How to cite
Wazobia Eval: A Benchmark for Nigerian Pidgin Emotion Understanding, Sarcasm Detection, and Cultural Reasoning — arXiv:2608.21369 — arXiv (en), https://arxiv.org/abs/2608.21369 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3e18befdea23 (Metraipolis archive dc_3e18befdea23, sha256 b5d09ce91b655a233b008b4dce16b80253f3936a173634abde2bd36d3763124d)
BibTeX
@misc{dc3e18befdea23,
title = {Wazobia Eval: A Benchmark for Nigerian Pidgin Emotion Understanding, Sarcasm Detection, and Cultural Reasoning — arXiv:2608.21369},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.21369},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3e18befdea23; sha256 b5d09ce91b655a233b008b4dce16b80253f3936a173634abde2bd36d3763124d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.21369. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Nigerian Pidgin is one of Africa's most widely spoken languages, yet remains severely underrepresented in language model evaluation. Existing benchmarks primarily focus on translation, transcription, or generic sentiment analysis, leaving critical aspects of culturally grounded language understanding unmeasured. We introduce Wazobia Eval, a benchmark for evaluating Nigerian Pidgin emotion understanding, sarcasm detection, and cultural reasoning. The benchmark is built on a manually annotated dataset containing over 550 examples and a 16-category emotion taxonomy designed to capture culturally specific emotional registers that are not represented in conventional sentiment frameworks. Wazobia Eval provides standardized evaluation protocols and benchmark tasks for assessing model performance on nuanced Nigerian language understanding. We present the benchmark design, annotation methodology, taxonomy development process, and preliminary pilot evaluation results. Our goal is to provide foundational evaluation infrastructure for Nigerian language AI and establish a reproducible benchmark for future research. The dataset is publicly available at this https URL . Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-25 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.21369 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T07:37:52.794Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-25?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).