Metraipolis › archive › dc_0bd0118e4ee4
One Strategy Does Not Fit All: Rethinking Data Labeling for Just-in-Time Vulnerability Prediction — arXiv:2611.05013
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.05013
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-04T18:56:27.578Z
- SHA-256 of the archived text
659087c0f1c2e0b911b7adf00b4856fda0c14b9c3414bad1fe05662e151756fe- Stable URL of this page
https://metraipolis.com/documento/dc_0bd0118e4ee4
How to cite
One Strategy Does Not Fit All: Rethinking Data Labeling for Just-in-Time Vulnerability Prediction — arXiv:2611.05013 — arXiv (en), https://arxiv.org/abs/2611.05013 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_0bd0118e4ee4 (Metraipolis archive dc_0bd0118e4ee4, sha256 659087c0f1c2e0b911b7adf00b4856fda0c14b9c3414bad1fe05662e151756fe)
BibTeX
@misc{dc0bd0118e4ee4,
title = {One Strategy Does Not Fit All: Rethinking Data Labeling for Just-in-Time Vulnerability Prediction — arXiv:2611.05013},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.05013},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_0bd0118e4ee4; sha256 659087c0f1c2e0b911b7adf00b4856fda0c14b9c3414bad1fe05662e151756fe},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.05013. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Just-In-Time Vulnerability Prediction (JIT-VP) identifies security risks in code changes at commit time, enabling early feedback before vulnerabilities enter software systems. However, its practical reliability is challenged by the difficulty of constructing accurate labels. Multiple strategies with different trade-offs have been proposed to identify vulnerability-fixing commits (VFCs) and vulnerability-introducing commits (VICs) for dataset construction, leading to substantially different datasets. This makes it difficult to separate model performance from dataset construction. Moreover, real-world quality assurance requires not only classification but also prioritizing high-risk commits and localizing vulnerable causes. This paper presents an extensive empirical study of how labeling strategies affect these downstream tasks. We constructed 28 datasets using four VFC and four VIC labeling strategies across OpenSSL and Linux kernel, then evaluated six representative JIT-VP models for classification, prioritization, and localization. Our results show that labeling effectiveness is strongly task-dependent. Manual VFC labeling combined with vulnerability-specific VIC labeling provides the most reliable performance for classification and prioritization, significantly outperforming 11 of 15 alternatives. Meanwhile, precision-first VFC labeling combined with LLM-assisted VIC labeling performs best for localization, significantly outperforming 7 of 15 alternatives. These findings demonstrate that no single labeling strategy is universally optimal and highlight the importance of task-oriented dataset construction. Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.SE, nuovi lavori del giorno). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2611.05013 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-04T18:35:52.149Z dalla pagina https://arxiv.org/list/cs.SE/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).