Metraipolis › archive › dc_ec6e52c3eb6a
Unlocking Criminal Court Decisions: Flexible Information Extraction for Empirical Legal Research — arXiv:2611.03051
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.03051
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T18:20:18.839Z
- SHA-256 of the archived text
9b61566be101194aebbd8f7f1a2941ab24f7a89b6e24778a8f2d34d3f35dd8b0- Stable URL of this page
https://metraipolis.com/documento/dc_ec6e52c3eb6a
How to cite
Unlocking Criminal Court Decisions: Flexible Information Extraction for Empirical Legal Research — arXiv:2611.03051 — arXiv (en), https://arxiv.org/abs/2611.03051 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ec6e52c3eb6a (Metraipolis archive dc_ec6e52c3eb6a, sha256 9b61566be101194aebbd8f7f1a2941ab24f7a89b6e24778a8f2d34d3f35dd8b0)
BibTeX
@misc{dcec6e52c3eb6a,
title = {Unlocking Criminal Court Decisions: Flexible Information Extraction for Empirical Legal Research — arXiv:2611.03051},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.03051},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ec6e52c3eb6a; sha256 9b61566be101194aebbd8f7f1a2941ab24f7a89b6e24778a8f2d34d3f35dd8b0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03051. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Criminal verdicts contain descriptions of criminal behavior that can support quantitative legal research, but structuring them requires attributes and extraction rules that cannot always be fully specified in advance. We present an LLM-based pipeline that builds a structured dataset through attribute exploration, text span extraction, and value normalization, guided by annotation instructions that legal experts can refine. We evaluate it on two traffic offenses: driving under the influence (DUI) and driving despite a ban (DDB). For DUI, revising the instructions was associated with higher extraction accuracy (from 52% to 70% of correctly extracted values) and higher agreement between human annotators. Repeated runs of the same model agreed with each other more than with the gold annotations, showing that consistent output is not necessarily correct, while disagreement between annotators and between models helped reveal unclear instructions. For DDB, where the instructions defined fixed categories and output formats, agreement was high for most attributes. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2611.03051 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T18:09:53.734Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).