Metraipolis › archive › dc_b216bf3b2b73
Benchmarking LLM Compliance with China AI Generated Content Regulations — arXiv:2609.19989
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.19989
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-10T03:16:06.461Z
- SHA-256 of the archived text
eed4dc2b569ca91fc4f44c7ba8cca8f2984f0b1d1fb87ffeee166c972759c4d5- Stable URL of this page
https://metraipolis.com/documento/dc_b216bf3b2b73
How to cite
Benchmarking LLM Compliance with China AI Generated Content Regulations — arXiv:2609.19989 — arXiv (en), https://arxiv.org/abs/2609.19989 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b216bf3b2b73 (Metraipolis archive dc_b216bf3b2b73, sha256 eed4dc2b569ca91fc4f44c7ba8cca8f2984f0b1d1fb87ffeee166c972759c4d5)
BibTeX
@misc{dcb216bf3b2b73,
title = {Benchmarking LLM Compliance with China AI Generated Content Regulations — arXiv:2609.19989},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.19989},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b216bf3b2b73; sha256 eed4dc2b569ca91fc4f44c7ba8cca8f2984f0b1d1fb87ffeee166c972759c4d5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.19989. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
The widespread adoption of LLMs has led to escalating content compliance risks. Prior works have contributed to addressing these risks in the English context, downplaying the complexity of Chinese language content. This paper follows China's current AI-Generated content compliance requirements and provides evaluation results on 20 notable LLMs, offering insight into China's regulatory landscape. We design a novel framework to assess the compliance and refusal rates with 2303 questions spanning six distinct dimensions, including 203 self-constructed constitutional questions. The framework employs several judges to generate verdicts independently based on their hierarchical alignment memory. Our findings show that international models also exhibit high levels of compliance despite the use of standard Chinese questions, and the main differences may stem from dimensions closely related to ideological alignment. We establish a regulatory benchmark that enables the global AI community to evaluate both Chinese and non-Chinese LLMs under a unified set of legally grounded compliance requirements. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-18 in cs.MA). Categorie arXiv: Computation and Language (cs.CL) ; Multiagent Systems (cs.MA). Pagina del lavoro: https://arxiv.org/abs/2609.19989 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-10T03:03:51.719Z dalla pagina https://arxiv.org/catchup/cs.MA/2026-09-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).