Metraipolis › archive › dc_487ae4b0fc53

Sustainability of Open-Source Machine Learning Robustness Assessment Tools: A Repository Mining Study — arXiv:2608.28396

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.28396
License (as archived)
CC0-1.0
Archived
2026-10-17T11:14:06.589Z
SHA-256 of the archived text
a2b87a888b9cafcb7a38ade9205aa850d5ffaa36515c8722e58fa86ffdddf472
Stable URL of this page
https://metraipolis.com/documento/dc_487ae4b0fc53

How to cite

Sustainability of Open-Source Machine Learning Robustness Assessment Tools: A Repository Mining Study — arXiv:2608.28396 — arXiv (en), https://arxiv.org/abs/2608.28396 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_487ae4b0fc53 (Metraipolis archive dc_487ae4b0fc53, sha256 a2b87a888b9cafcb7a38ade9205aa850d5ffaa36515c8722e58fa86ffdddf472)
BibTeX
@misc{dc487ae4b0fc53,
  title = {Sustainability of Open-Source Machine Learning Robustness Assessment Tools: A Repository Mining Study — arXiv:2608.28396},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.28396},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_487ae4b0fc53; sha256 a2b87a888b9cafcb7a38ade9205aa850d5ffaa36515c8722e58fa86ffdddf472},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.28396. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Robustness evaluation is essential for deploying machine-learning (ML) systems in real-world settings, where models may face adversarial perturbations, distribution shifts, and other operational stressors. Many open-source tools, including Adversarial Robustness Toolbox, Foolbox, and Robustness Gym, support robustness testing and evaluation. However, little is known about how these tools are maintained, publicly engaged with, and sustained over time, even though practitioners may rely on them to select evaluation dependencies, reproduce robustness assessments, and provide evidence for AI assurance. We present an empirical study of the open-source robustness tooling ecosystem. Starting from a curated seed set derived from prior work, we systematically searched GitHub and identified 28 robustness-tool repositories. We analyzed repository artifacts to characterize observable community engagement, maintenance activity, and project longevity using established software-engineering metrics. Our results show that engagement and maintenance are unevenly distributed, with sustained activity concentrated in a small subset of repositories. At the data collection date of January 21, 2026, five repositories were classified as active, 22 as inactive, and one as archived. These findings highlight the need to treat robustness tools as evolving software systems.

Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-31 in cs.SE).
Categorie arXiv: Software Engineering (cs.SE).
Pagina del lavoro: https://arxiv.org/abs/2608.28396 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T10:56:43.379Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-31?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).