Metraipolis › archive › dc_7ae33110c4d9
SafeStart: Mitigating the Overlooked Safety Cost of Active Expert Reduction in MoE LLM Serving — arXiv:2611.06147
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.06147
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-05T18:16:57.061Z
- SHA-256 of the archived text
c4d429c146364b401254954190ac817fd7d94430fa5442bb5d609e885fb2fc01- Stable URL of this page
https://metraipolis.com/documento/dc_7ae33110c4d9
How to cite
SafeStart: Mitigating the Overlooked Safety Cost of Active Expert Reduction in MoE LLM Serving — arXiv:2611.06147 — arXiv (en), https://arxiv.org/abs/2611.06147 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7ae33110c4d9 (Metraipolis archive dc_7ae33110c4d9, sha256 c4d429c146364b401254954190ac817fd7d94430fa5442bb5d609e885fb2fc01)
BibTeX
@misc{dc7ae33110c4d9,
title = {SafeStart: Mitigating the Overlooked Safety Cost of Active Expert Reduction in MoE LLM Serving — arXiv:2611.06147},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.06147},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7ae33110c4d9; sha256 c4d429c146364b401254954190ac817fd7d94430fa5442bb5d609e885fb2fc01},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.06147. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Mixture-of-Experts (MoE) language models send each token through a few of many expert subnetworks. Serving methods make these models faster by running even fewer experts per token, and they are validated on accuracy benchmarks. We show that these methods can weaken the model's refusal of harmful requests, and we introduce SafeStart, which largely restores refusal while keeping most of the speedup. In vLLM on one RTX A6000, keeping about two thirds of the selected experts speeds up offline decoding by 15 to 28% at batch size 8. We find that, at this setting, under a jailbreak that tells the model not to refuse, the share of harmful requests that the model answers rises by 18.4 percentage points on Qwen1.5-MoE, 9.5 on OLMoE, and 6.6 on DeepSeek-V2-Lite, the three of nine models where it rises significantly, while MMLU accuracy drops by less than two points. We discover that most of this increase arises while the model processes the prompt and generates its first few tokens. SafeStart therefore runs all experts for the prompt and the first eight generated tokens, and the reduced set of experts afterwards, through a fused kernel in vLLM. With experts removed, SafeStart keeps at least 85% of the offline decode speedup at batch sizes 8 and 32 and brings the change under this jailbreak to between -2.1 and +1.3 points for three expert-reduction methods on these three models. On 889 held-out requests, in an analysis fixed before generation, truncation raises harmful compliance by 5.8 to 21.4 points, and SafeStart leaves a rise of 0.6 to 2.6 points, non-inferior to the original model on two of the three models. Our results show that faster MoE serving need not cost safety: a serving system can keep most of the gain from running fewer experts by running all of them at the start of each response, and it should test refusal, not only accuracy, before it enables such a method. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2611.06147 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-05T18:12:49.007Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).