Metraipolis › archive › dc_064fb24908f6

CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords — arXiv:2609.21722

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.21722
License (as archived)
CC0-1.0
Archived
2026-10-10T01:12:48.809Z
SHA-256 of the archived text
d5b4cae511ba2d35e1acc9d69d956d8fc40717cd591acfc3743c64821993f75c
Stable URL of this page
https://metraipolis.com/documento/dc_064fb24908f6

How to cite

CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords — arXiv:2609.21722 — arXiv (en), https://arxiv.org/abs/2609.21722 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_064fb24908f6 (Metraipolis archive dc_064fb24908f6, sha256 d5b4cae511ba2d35e1acc9d69d956d8fc40717cd591acfc3743c64821993f75c)
BibTeX
@misc{dc064fb24908f6,
  title = {CIBuzzBench: A Benchmark for Cross-Lingual Understanding of Chinese Internet Buzzwords — arXiv:2609.21722},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.21722},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_064fb24908f6; sha256 d5b4cae511ba2d35e1acc9d69d956d8fc40717cd591acfc3743c64821993f75c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.21722. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Chinese social media has generated a vast and continually evolving lexicon of internet buzzwords whose meanings are often non-literal and deeply rooted in local cultural and pragmatic contexts. Existing research has primarily focused on interpreting these buzzwords within Chinese, leaving largely unexplored whether LLMs can transfer such culturally grounded knowledge across languages and accurately convey the intended meanings in English. This cross-lingual capability is also critical for safety, as harmful expressions may obscure their offensive content through culture-specific homophony, euphemism, irony, or coded language. In this paper, we investigate the ability of advanced LLMs to understand Chinese internet buzzwords across languages. To this end, we introduce CIBuzzBench, the first benchmark for cross-lingual Chinese-to-English understanding of Chinese internet buzzwords. CIBuzzBench comprises 3,001 Chinese internet buzzwords annotated with English meaning explanations, English equivalents, category labels, and harmfulness labels. Based on these annotations, we design three evaluation tasks: Meaning Explanation, Cross-lingual Equivalent Matching, and Culturally Grounded Harmfulness Detection. We evaluate representative state-of-the-art proprietary and Chinese LLMs under both English- and Chinese-prompting settings. Our results show that LLMs continue to struggle with the cross-lingual understanding of Chinese internet buzzwords, particularly in fine-grained non-literal interpretation, robust equivalent matching under option perturbations, and calibrated harmfulness detection. These findings highlight the persistent challenges posed by culturally grounded language phenomena for multilingual LLMs and safety-oriented evaluation. The dataset and code are available at this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-21 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.21722 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-10T00:23:42.561Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-21?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).