Metraipolis › archive › dc_8b7db4ded426
CreateScore: Domain-Theory-Informed Bayesian Routing for LLM-Based CV Screening — arXiv:2610.02972
- Source
- arXiv
- Original
- https://arxiv.org/abs/2610.02972
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-05T22:49:24.162Z
- SHA-256 of the archived text
416af6bc5621081e9f26b054ddf79b0e96288c45e831545170315e097fbd5e3e- Stable URL of this page
https://metraipolis.com/documento/dc_8b7db4ded426
How to cite
CreateScore: Domain-Theory-Informed Bayesian Routing for LLM-Based CV Screening — arXiv:2610.02972 — arXiv, https://arxiv.org/abs/2610.02972 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_8b7db4ded426 (Metraipolis archive dc_8b7db4ded426, sha256 416af6bc5621081e9f26b054ddf79b0e96288c45e831545170315e097fbd5e3e)
BibTeX
@misc{dc8b7db4ded426,
title = {CreateScore: Domain-Theory-Informed Bayesian Routing for LLM-Based CV Screening — arXiv:2610.02972},
howpublished = {arXiv},
url = {https://arxiv.org/abs/2610.02972},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_8b7db4ded426; sha256 416af6bc5621081e9f26b054ddf79b0e96288c45e831545170315e097fbd5e3e},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv, https://arxiv.org/abs/2610.02972. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models (LLMs) can support rubric-based screening of CVs, but applying a high-capability model to every candidate and criterion is costly. We present CreateScore, a domain-theory-informed Bayesian network for criterion-level LLM routing. A hand-specified directed acyclic graph with Dirichlet-multinomial conditional probability tables converts CV evidence into posterior uncertainty; low-uncertainty decisions are resolved by a local 8B model and uncertain ones are escalated to a 120B reference model. The graph is causally motivated, but the system performs standard Bayesian conditioning, not causal inference. The escalation threshold is calibrated on a training fold (target: 70% resolved locally) and then frozen. On 200 synthetic Data Science CVs (139 training and 61 test candidates, five criteria), 77.7% of criterion decisions were resolved locally (237 of 305). Relative to a reference condition in which the 120B model adjudicated every criterion, routed escalation reduced token use by 65.2% and raised exact score agreement from 32.8% (8B alone) to 42.6% (95% CI 31.0-55.1%); at n = 61 the gain was not statistically distinguishable. The uncertainty signal did not, however, identify the decisions on which the 8B model erred: disagreement with the reference was 16.2% among escalated and 19.4% among locally resolved decisions (AUROC 0.47, 95% CI 0.39-0.56), no better than random selection. We also document how an earlier evaluation was invalidated when truncated reasoning-model outputs were silently replaced by local labels, and we recommend safeguards for cascade evaluation. CreateScore is supported as an auditable cost-reduction mechanism, not yet as a targeted error detector, and is not an autonomous hiring system. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Applications (stat.AP). Pagina del lavoro: https://arxiv.org/abs/2610.02972 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-05T22:45:55.656Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).