Metraipolis › archive › dc_158bf508fe5e
RegDivergence-101: An LLM Benchmark for Cross-Jurisdiction Regulatory Contradiction Detection in Life Sciences — arXiv:2608.28607
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.28607
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T07:41:38.485Z
- SHA-256 of the archived text
a98a82f487bd102c2628fe10e8a53746ec07f6eec668c19530833cab7bed2f34- Stable URL of this page
https://metraipolis.com/documento/dc_158bf508fe5e
How to cite
RegDivergence-101: An LLM Benchmark for Cross-Jurisdiction Regulatory Contradiction Detection in Life Sciences — arXiv:2608.28607 — arXiv (en), https://arxiv.org/abs/2608.28607 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_158bf508fe5e (Metraipolis archive dc_158bf508fe5e, sha256 a98a82f487bd102c2628fe10e8a53746ec07f6eec668c19530833cab7bed2f34)
BibTeX
@misc{dc158bf508fe5e,
title = {RegDivergence-101: An LLM Benchmark for Cross-Jurisdiction Regulatory Contradiction Detection in Life Sciences — arXiv:2608.28607},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.28607},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_158bf508fe5e; sha256 a98a82f487bd102c2628fe10e8a53746ec07f6eec668c19530833cab7bed2f34},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.28607. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Pharmaceutical sponsors developing a drug for both the United States and the European Union must reconcile guidance issued independently by the FDA and the EMA. Where the two agencies require substantively the same thing, a sponsor can file once; where they diverge, a single trial design risks rejection in one region; where one agency is silent on a point the other regulates, the sponsor must infer obligations. Today this reconciliation is performed manually by regulatory-affairs experts. We introduce cross-jurisdiction regulatory divergence detection: given an FDA requirement and an EMA requirement on the same topic, classify their relationship as AGREE, DIVERGE, or SILENT. SILENT is inherently directional (SILENT_FDA vs. SILENT_EMA); we record direction per pair and report per-direction F1 alongside the collapsed label. We release RegDivergence-101, a 101-pair expert-grounded pilot evaluation benchmark (labels grounded in three peer-reviewed FDA/EMA comparison studies and primary FDA/EMA/ICH guidance text; dual-annotation inter-annotator kappa = 0.85), and systematically characterise a four-method baseline hierarchy: lexical heuristic (0.511 macro-F1, 95% CI [0.411-0.605]), NLI cross-encoder (0.233), obligation-level Graph-RAG (0.663 [0.570-0.747]), and flat LLM judge / Claude Haiku (0.830 [0.747-0.908]). Three directional observations emerge at pilot scale (n = 101): SILENT is semantically detectable but invisible to entailment-only formulations; pair-level obligation graphs improve over lexical methods but trail flat-LLM context (CIs partially overlapping); and corpus-level graph construction is the indicated architectural target for large-scale silent-detection. RegDivergence-101 is a pilot release establishing the task formulation and baseline hierarchy; four unrepresented regulatory domains and an expansion roadmap are described in Section 7. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2608.28607 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T07:28:26.453Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).