Metraipolis › archive › dc_54e2967514de

Characterizing Overconfident Failure in LLM-Based Code Generation — arXiv:2610.11300

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.11300
License (as archived)
CC0-1.0
Archived
2026-10-09T05:57:33.097Z
SHA-256 of the archived text
dfc423c378c27e50da0727e30dba7a5356aa5883aa435d4bfe0af40906bb1c28
Stable URL of this page
https://metraipolis.com/documento/dc_54e2967514de

How to cite

Characterizing Overconfident Failure in LLM-Based Code Generation — arXiv:2610.11300 — arXiv (en), https://arxiv.org/abs/2610.11300 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_54e2967514de (Metraipolis archive dc_54e2967514de, sha256 dfc423c378c27e50da0727e30dba7a5356aa5883aa435d4bfe0af40906bb1c28)
BibTeX
@misc{dc54e2967514de,
  title = {Characterizing Overconfident Failure in LLM-Based Code Generation — arXiv:2610.11300},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.11300},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_54e2967514de; sha256 dfc423c378c27e50da0727e30dba7a5356aa5883aa435d4bfe0af40906bb1c28},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.11300. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) are increasingly used for automated code generation, but generated programs can appear syntactically plausible while still failing execution-based correctness checks. Existing validation methods, such as testing and program analysis, remain essential but are often incomplete, costly, or applied only after generation. Model-derived uncertainty is therefore a natural early reliability signal. This paper studies the dilemma of overconfidence in code LLMs where incorrect programs are often generated with token-level confidence comparable to correct programs. We study this dilemma across four open-source code models and three execution-based benchmarks. Our analysis begins by investigating whether existing uncertainty metrics provide reliable proxies for execution correctness in code generation. We then characterize overconfidence at both global and local token levels, asking whether incorrect programs remain indistinguishable from correct ones under confidence and entropy summaries, including selective generation and the limits of instruction tuning. Finally, we evaluate whether common mitigation strategies reduce this failure mode. Our study yields four findings. First, existing uncertainty signals provide only partial and model-dependent evidence of execution failure. Second, overconfidence persists at both program and token levels, and uncertainty-based selection does not consistently improve accepted-set accuracy. Third, instruction tuning can increase certainty on failing generations without consistently improving correctness discrimination. Fourth, common mitigation techniques improve specific aspects of reliability but do not reliably resolve overconfident failure. Our exploratory latent analysis suggests that hidden representations may encode correctness-related signals that output confidence does not expose.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.11300 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T05:47:01.606Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).