

















Abstract:Machine unlearning aims to remove the influence of specific data from trained language models. In real-world deployments, unlearning requests often arrive sequentially, which challenges existing fine-tuning-based methods: fine-tuning each request is costly, accumulates utility loss, and may cause cross-request interference. To address these issues, we propose ICCU (In-Context Continual Unlearning), an in-context continual unlearning framework that induces readable refusal rules from unlearning datasets and applies them at inference time either as a filter or via the system prompt, without modifying model parameters. Because rules are accumulated as an order-independent union, ICCU is compositional and free of cross-request interference, and the original forget-set data can be discarded after rule induction. Extensive experiments show that ICCU effectively suppresses target knowledge while preserving utility, scales across sequential requests, and remains robust to paraphrased and cross-lingual queries.
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2605.27138 [cs.AI] |
| (or arXiv:2605.27138v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2605.27138 arXiv-issued DOI via DataCite (pending registration) |
From: Ruihao Pan [view email]
[v1]
Tue, 26 May 2026 15:06:56 UTC (1,001 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。