



















Abstract:Sharpness-Aware Minimization (SAM) improves generalization by minimizing the worst-case loss within a fixed parameter-space radius neighborhood. SAM and its variants mainly rely on a first-order linearized surrogate, while flat minima are inherently a second-order (curvature) this http URL revisit this mismatch and propose Loss-Equated SAM (LE-SAM), which inverts the traditional SAM mechanism that fixed perturbation radius with a fixed loss-space budget,effectively removing gradient-norm-dominated learning signals and shifting optimization toward curvature-dominated terms. Extensive experiments across diverse benchmarks and tasks demonstrate the strong generalization ability of LESAM that consistently outperforms SAM and even its variants, achieving the state-of-the-art performance.
| Comments: | Accepted by ICML2026 |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.10183 [cs.LG] |
| (or arXiv:2605.10183v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.10183 arXiv-issued DOI via DataCite (pending registration) |
From: Jinping Wang [view email]
[v1]
Mon, 11 May 2026 08:34:36 UTC (3,229 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。