Metraipolis › archive › dc_96997d87cba5
Fast Unsupervised Anomaly Detection Methods on Software Logs - An Empirical Study — arXiv:2611.07760
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.07760
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:51:31.148Z
- SHA-256 of the archived text
9f865f013bc091cd861e0455832c4d86631bf8bf015a2aa5bd82728727314ab4- Stable URL of this page
https://metraipolis.com/documento/dc_96997d87cba5
How to cite
Fast Unsupervised Anomaly Detection Methods on Software Logs - An Empirical Study — arXiv:2611.07760 — arXiv (en), https://arxiv.org/abs/2611.07760 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_96997d87cba5 (Metraipolis archive dc_96997d87cba5, sha256 9f865f013bc091cd861e0455832c4d86631bf8bf015a2aa5bd82728727314ab4)
BibTeX
@misc{dc96997d87cba5,
title = {Fast Unsupervised Anomaly Detection Methods on Software Logs - An Empirical Study — arXiv:2611.07760},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.07760},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_96997d87cba5; sha256 9f865f013bc091cd861e0455832c4d86631bf8bf015a2aa5bd82728727314ab4},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.07760. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Anomaly detection on software logs ensures system reliability through failure identification, root cause analysis and fault localization. While supervised models show excellent performance, in a practical setting there rarely are labeled training data available. This calls for the use of unsupervised models. We study effects of data preprocessing, anomaly detection method, and the dataset. For preprocessing, we examine three options: The use of anomaly-free training data, using randomized as opposed to chronologically selected training data, and the use of a custom loader to extract log message from the log line. Regarding anomaly detection we use four models (KMeans, IsolationForest, RarityModel, Out-Of-Vocabulary Detector) and three representations (Words, trigrams, and parsed events). We evaluate these approaches on seven datasets: BGL, HDFS, Hadoop, Spirit, Thunderbird, Liberty, and LO2Token. We run each combination of the selected factors and measure performance with AUCROC and F1-score metrics. Then we utilize a generalized linear model to establish relationships between the factors. Furthermore, we address execution times. Our evidence reveals large variability across all datasets, preventing us from making recommendations that apply universally. For instance, log parsing enhances performance on some datasets but reduces it on others. The evidence suggests that using anomaly-free data for training unsupervised models can improve anomaly detection performance, though this requires extra effort to identify such this http URL work has argued that shuffling data leads to unrealistic model performance (data leakage). Yet, our results show this does not hold for the unsupervised models we tested, while it remains true for supervised models in the same setup. For fast execution of the pipeline, use word representation and avoid IsolationForest model. Tema degli esploratori: calcolo e infrastrutture (elenco arXiv cs.SE, nuovi lavori del giorno). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2611.07760 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-06T14:21:57.533Z dalla pagina https://arxiv.org/list/cs.SE/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).