Metraipolis › archive › dc_003fcbdafb91
When Does Combining Software-Effort Estimates Help? Evidence from Four Public Project Datasets — arXiv:2611.06948
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.06948
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:51:25.156Z
- SHA-256 of the archived text
1ec2e72bd746af47de37ca7c06c6730bf0b1df6a0f8e35b81a1b274b5449c9ce- Stable URL of this page
https://metraipolis.com/documento/dc_003fcbdafb91
How to cite
When Does Combining Software-Effort Estimates Help? Evidence from Four Public Project Datasets — arXiv:2611.06948 — arXiv (en), https://arxiv.org/abs/2611.06948 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_003fcbdafb91 (Metraipolis archive dc_003fcbdafb91, sha256 1ec2e72bd746af47de37ca7c06c6730bf0b1df6a0f8e35b81a1b274b5449c9ce)
BibTeX
@misc{dc003fcbdafb91,
title = {When Does Combining Software-Effort Estimates Help? Evidence from Four Public Project Datasets — arXiv:2611.06948},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.06948},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_003fcbdafb91; sha256 1ec2e72bd746af47de37ca7c06c6730bf0b1df6a0f8e35b81a1b274b5449c9ce},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06948. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Combining estimates can reduce individual prediction errors, but an ensemble may also dilute an unusually accurate estimator or repeat errors shared by its members. We study these competing effects on four archival software-effort datasets (Kitchenham: 145 projects, Desharnais: 77, China: 499, Maxwell: 63) with 100 repeated 70/30 training and test partitions per dataset. Three conventional models (parametric regression, analogy, and random forest) are combined with each other and, in Kitchenham, with a recorded human estimate. Out-of-fold calibration errors drive five combination rules: equal weighting, inverse-MSE weighting, a nonnegative simplex combination, signed Bates-Granger weighting, and Bates-Granger with covariance shrinkage. All preprocessing is learned within training folds. Model-error correlations range from 0.54 to 0.97. In Kitchenham, the human estimate dominates: equal weighting raises mean test log-MAE from 0.239 to 0.455, a loss that remains significant under a corrected resampled t-test with Holm adjustment, whereas the simplex rule limits the increase to 0.250. In Desharnais, China, and Maxwell, every rule lowers mean log-MAE (by 1.3 to 8.6%) and BG with shrinkage beats the calibration-selected individual on 75, 83, and 83 of 100 splits, but none of these gains is statistically distinguishable from zero once the overlap between repeated splits is accounted for. On a completion-year split of Desharnais, equal weighting becomes slightly worse and inverse-MSE is near the individual baseline, while simplex and shrinkage retain mean gains of about 5%. Combining correlated effort estimates is therefore a conditional decision: the harm of naive pooling next to a dominant source is clear, while the benefit elsewhere is small and uncertain. Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.SE, nuovi lavori del giorno). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2611.06948 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-06T14:21:57.527Z dalla pagina https://arxiv.org/list/cs.SE/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).