Metraipolis › archive › dc_ebce3a454bdc
LLM Ensemble Fault Classification for Automotive HiL Validation — arXiv:2608.10710
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.10710
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T06:22:14.279Z
- SHA-256 of the archived text
7fdd6b6b5b44a466a79cdcc0f46afdf39ed65c0dc8bf069826e77d70deab72b5- Stable URL of this page
https://metraipolis.com/documento/dc_ebce3a454bdc
How to cite
LLM Ensemble Fault Classification for Automotive HiL Validation — arXiv:2608.10710 — arXiv (en), https://arxiv.org/abs/2608.10710 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ebce3a454bdc (Metraipolis archive dc_ebce3a454bdc, sha256 7fdd6b6b5b44a466a79cdcc0f46afdf39ed65c0dc8bf069826e77d70deab72b5)
BibTeX
@misc{dcebce3a454bdc,
title = {LLM Ensemble Fault Classification for Automotive HiL Validation — arXiv:2608.10710},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.10710},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ebce3a454bdc; sha256 7fdd6b6b5b44a466a79cdcc0f46afdf39ed65c0dc8bf069826e77d70deab72b5},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.10710. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Automotive HiL validation generates large multivariate test recordings whose analysis remains challenging due to manual review effort, rule-based limitations, and the need for explainable diagnostic decisions. Recent machine-learning and deep-learning approaches have improved fault diagnosis, but they often require large labelled datasets, generalise poorly across operating conditions, and provide limited insight into their predictions. This paper proposes an explainable multi-LLM ensemble framework for sensor-level fault classification in automotive validation. The framework uses compact evidence representations of fault-injection recordings and combines the outputs of heterogeneous large language models to improve diagnostic robustness, ranking quality, confidence reliability, and interpretability. The approach is evaluated on gasoline-engine and electric-vehicle HiL systems across three driving settings and ten single-fault classes. Among the individual models, Mistral Small~24B provides the strongest overall single-model trade-off, achieving 0.903 Top-1 accuracy, 0.887 MCC, and the lowest Brier score of 0.102. The final Top-3 ensemble combines Mistral Small~24B, Qwen2.5~32B, and Phi-4~14B using confidence-weighted voting, improving the scenario-averaged results to 0.917 Top-1 accuracy, 0.913 macro F1, and 0.902 MCC, while also providing the best calibration among the tested ensemble strategies. A Top-5 ensemble does not improve over the Top-3 configuration, indicating that model complementarity is more important than ensemble size. The results show that coordinated multi-LLM reasoning can support robust, calibrated, and engineer-interpretable fault classification for automotive HiL validation. Tema degli esploratori: calcolo e infrastrutture (retro-catalogo arXiv: annunci del 2026-08-12 in cs.SE). Categorie arXiv: Software Engineering (cs.SE). Pagina del lavoro: https://arxiv.org/abs/2608.10710 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T06:14:48.478Z dalla pagina https://arxiv.org/catchup/cs.SE/2026-08-12?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).