Metraipolis › archive › dc_a5423cbec4fe
The Recall Trap: A Recall-Maximizing Retriever Configuration Reduces Issue Resolution in Fixed-Budget Code Context — arXiv:2608.14838
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.14838
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T19:01:10.436Z
- SHA-256 of the archived text
f649b6f3338201bebd5dc53888b3339d643e7a8e17c00f2104d09131b913f872- Stable URL of this page
https://metraipolis.com/documento/dc_a5423cbec4fe
How to cite
The Recall Trap: A Recall-Maximizing Retriever Configuration Reduces Issue Resolution in Fixed-Budget Code Context — arXiv:2608.14838 — arXiv (en), https://arxiv.org/abs/2608.14838 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a5423cbec4fe (Metraipolis archive dc_a5423cbec4fe, sha256 f649b6f3338201bebd5dc53888b3339d643e7a8e17c00f2104d09131b913f872)
BibTeX
@misc{dca5423cbec4fe,
title = {The Recall Trap: A Recall-Maximizing Retriever Configuration Reduces Issue Resolution in Fixed-Budget Code Context — arXiv:2608.14838},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.14838},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a5423cbec4fe; sha256 f649b6f3338201bebd5dc53888b3339d643e7a8e17c00f2104d09131b913f872},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.14838. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Retrieval components for code assistants are tuned against retrieval metrics: a configuration that raises recall@k is adopted, and downstream task success is assumed to follow. We report a controlled case study in code repair, not a new phenomenon but a deployed-flag, execution-graded instance of the known relevance-diversity and objective-mismatch tradeoff (Levy et al., 2025). On SWE-bench Verified we inject a retriever's hits as a fixed 12-slot context pack with no search tools and toggle one flag (one-chunk-per-file deduplication) on an otherwise identical stack. The flag is the higher-recall configuration (gold file present in 0.878 of served packs against 0.806 disabled), yet disabling it, trading file breadth for within-file depth, raises the single-shot resolve rate: gpt-5.6-sol +7.6pp (39.2% to 46.8%, n=500, McNemar exact p=0.0003), and a pre-registered open-weights replication any reviewer can re-run (Qwen3.6-27B, +3.6pp, n=499, p=0.0133); both survive repository-clustered inference. The gain tracks within-file anchor dose, and a random-chunk control refutes an argmax-selection artifact. We map where it holds: it reverses on a lexical BM25 retriever (-3.2pp, significant cross-paradigm interaction), is not detected under unrestricted-Read agents (a powered null), and across four languages (SWE-PolyBench, N=617) is positive but not significant (+2.6pp, p=0.056), a mapped boundary rather than a confirmed extension. Operationally, at a tight fixed budget: do not hard-deduplicate by file, and A/B packing policies against the task, not the metric the flag was tuned to. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-18 in cs.CL). Categorie arXiv: Software Engineering (cs.SE) ; Computation and Language (cs.CL); Information Retrieval (cs.IR). Pagina del lavoro: https://arxiv.org/abs/2608.14838 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T18:06:57.914Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).