Metraipolis › archive › dc_cec56f5fdeab
Where the Numbers Come From: Auditing Evaluation in Provenance-Based Intrusion Detection — arXiv:2609.33532
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.33532
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T22:34:39.053Z
- SHA-256 of the archived text
eb587e269bf80ce1a21bd69b7d2d5d0bcfb09d48627481ff0ea595483c6abec7- Stable URL of this page
https://metraipolis.com/documento/dc_cec56f5fdeab
How to cite
Where the Numbers Come From: Auditing Evaluation in Provenance-Based Intrusion Detection — arXiv:2609.33532 — arXiv (en), https://arxiv.org/abs/2609.33532 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cec56f5fdeab (Metraipolis archive dc_cec56f5fdeab, sha256 eb587e269bf80ce1a21bd69b7d2d5d0bcfb09d48627481ff0ea595483c6abec7)
BibTeX
@misc{dccec56f5fdeab,
title = {Where the Numbers Come From: Auditing Evaluation in Provenance-Based Intrusion Detection — arXiv:2609.33532},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.33532},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cec56f5fdeab; sha256 eb587e269bf80ce1a21bd69b7d2d5d0bcfb09d48627481ff0ea595483c6abec7},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.33532. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Reproducing a provenance-based intrusion detector's score does not establish what that score says about its emitted alarms or the information its encoder uses. We audit nine released implementations, execute four detectors using their own code, and isolate three measurement effects. First, a fixed-alert comparison separates label choice from neighbourhood credit: ThreaTrace reports precision 0.938 with neighbourhood credit, although only seven of its 994 alarms carry its own attack label. Second, removing test-label checkpoint selection lowers attack detection precision (ADP) by 0.16 to 0.33 across four forty-member word2vec configurations without changing detector order. Third, a buffer-reuse defect gives a linear encoder unintended degree-dependent inputs. Correcting it lowers type-only ADP in every identical-input initialization pair on two hosts, while historical word2vec effects depend on the host. These findings qualify claims from the inspected implementations about alarm precision, performance magnitude and static-attribute sufficiency. STRICT connects them to six checkable reporting requirements. Because the comparisons condition on benchmark targets, they neither validate those labels nor establish a universal detector ranking. Tema degli esploratori: fiducia digitale e crittografia (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CR). Categorie arXiv: Cryptography and Security (cs.CR). Pagina del lavoro: https://arxiv.org/abs/2609.33532 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T22:13:03.688Z dalla pagina https://arxiv.org/catchup/cs.CR/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).