Metraipolis › archive › dc_4eccb215f386
What Should LLMs Forget: Reinforcement Unlearning of Knowledge Associations — arXiv:2610.41616
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.41616
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-03T07:31:39.168Z
- SHA-256 of the archived text
fdf91b04da4bc8d3ab05537dfa97744469d4eed7026d208f70011949e2b1cecb- Stable URL of this page
https://metraipolis.com/documento/dc_4eccb215f386
How to cite
What Should LLMs Forget: Reinforcement Unlearning of Knowledge Associations — arXiv:2610.41616 — arXiv (en), https://arxiv.org/abs/2610.41616 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4eccb215f386 (Metraipolis archive dc_4eccb215f386, sha256 fdf91b04da4bc8d3ab05537dfa97744469d4eed7026d208f70011949e2b1cecb)
BibTeX
@misc{dc4eccb215f386,
title = {What Should LLMs Forget: Reinforcement Unlearning of Knowledge Associations — arXiv:2610.41616},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.41616},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4eccb215f386; sha256 fdf91b04da4bc8d3ab05537dfa97744469d4eed7026d208f70011949e2b1cecb},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.41616. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Large language models (LLMs) acquire extensive factual knowledge during pre-training, which may include sensitive, private, or copyrighted information, motivating the development of unlearning methods that selectively remove specific knowledge while preserving general capabilities. However, existing approaches typically optimize entire responses without explicitly identifying the knowledge to be forgotten, resulting in coarse and uncontrolled forgetting. To address this, we revisit the forgetting target of LLM unlearning and introduce Knowledge Association (KA), which characterizes the association between a query context and its target knowledge and is instantiated by the corresponding conditional predictive distribution, as the fundamental target of forgetting. Based on KA, we propose Knowledge Association Reinforcement Unlearning (KARU), a unified reinforcement learning framework that suppresses forgotten knowledge associations while preserving retained ones. Specifically, KARU derives complementary mechanisms from the KA-based formulation: token-level reward construction for finer-grained forgetting supervision, distribution-level regularization for precise knowledge suppression, and proximity-aware retain sampling to mitigate collateral degradation. Experiments across diverse LLMs on representative benchmarks demonstrate that KARU consistently improves forgetting effectiveness over existing baselines while maintaining comparable retention performance and general utility. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.41616 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-03T07:29:33.637Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).