Metraipolis › archive › dc_48bd3268879d
An LLM-Based Agent for Legal Compliance Assessment: Architecture, Memory, and Evaluation in a Canadian and Quebec Context — arXiv:2610.27347
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.27347
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-21T07:06:29.772Z
- SHA-256 of the archived text
a7a0d9244eb3b9f9457573d8e7e461ed2a3b2eed945604f20e7da1b6202e4e83- Stable URL of this page
https://metraipolis.com/documento/dc_48bd3268879d
How to cite
An LLM-Based Agent for Legal Compliance Assessment: Architecture, Memory, and Evaluation in a Canadian and Quebec Context — arXiv:2610.27347 — arXiv (en), https://arxiv.org/abs/2610.27347 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_48bd3268879d (Metraipolis archive dc_48bd3268879d, sha256 a7a0d9244eb3b9f9457573d8e7e461ed2a3b2eed945604f20e7da1b6202e4e83)
BibTeX
@misc{dc48bd3268879d,
title = {An LLM-Based Agent for Legal Compliance Assessment: Architecture, Memory, and Evaluation in a Canadian and Quebec Context — arXiv:2610.27347},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.27347},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_48bd3268879d; sha256 a7a0d9244eb3b9f9457573d8e7e461ed2a3b2eed945604f20e7da1b6202e4e83},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.27347. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Checking whether a text complies with a body of law is slow when done by hand and fragile when done with keyword rules. This paper presents ComplianceAgent, the legal compliance sub-agent of COMPASS, a multi-agent framework that evaluates texts along four axes: digital sovereignty, carbon impact, compliance, and ethics. The agent relies on a large language model that scores a text on a fixed rubric, grounds its judgment in a reference legal corpus, and, when the score falls at or below a critical threshold, runs a corrective chain made of self-healing rewrites, a compliance label, an explainability report, and escalation to a human reviewer. We describe what the language model does at each step, how the memory of the agent is organized, and how the same implementation can be pointed at different reference corpora. We evaluate the agent in a Canadian and Quebec context, on a corpus of thirteen legal instruments that brings together federal and provincial texts, international treaties, and municipal documents of the City of Trois-Rivières. The evaluation relies on a hand-annotated gold standard of fifteen texts and combines classification metrics, a repeated-query stability test, retrieval precision, and a composite score. On this gold standard the agent separates every conforming text from every non-conforming one, its scores remain stable under repeated queries, and the index returns relevant passages. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.27347 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-21T07:05:43.401Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).