Abstract:The deployment of quantized neural networks on edge devices, combined with privacy regulations like GDPR, creates an urgent need for machine unlearning in quantized models. However, existing methods face critical challenges: they induce forgetting by training models to memorize incorrect labels, conflating forgetting with misremembering, and employ scalar gradient reweighting that cannot resolve directional conflicts between gradients. We propose OEU, a novel Orthogonal Entropy Unlearning framework with two key innovations: 1) Entropy-guided unlearning provides an unbiased forgetting direction by maximizing prediction uncertainty on forgotten data, avoiding confident misprediction toward any specific class, and 2) Gradient orthogonal projection eliminates interference by projecting forgetting gradients onto the orthogonal complement of retain gradients, providing theoretical guarantees for utility preservation under first-order approximation. Extensive experiments demonstrate that OEU outperforms existing methods in both forgetting effectiveness and retain accuracy.
| Comments: | Accepted by ICML2026 |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2602.00567 [cs.LG] |
| (or arXiv:2602.00567v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2602.00567 arXiv-issued DOI via DataCite |
From: Yujia Tong [view email]
[v1]
Sat, 31 Jan 2026 07:18:55 UTC (2,241 KB)
[v2]
Fri, 22 May 2026 09:19:32 UTC (2,244 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。