Abstract:We present and analyze Frank-Wolfe with Moreau Envelope Smoothing (FRAMES) for solving nonsmooth nonconvex constrained optimization problems, taking advantage of iterative smoothing via the Moreau envelope followed by one Frank-Wolfe step per iteration. The problem template we consider encompasses splitting problems with multiple convex constraint sets as well as problems with nonsmooth weakly convex regularizers like the MCP or SCAD penalties. We prove convergence, with rates, for both of these cases under a variety of mild assumptions, including inconsistent problems. Additionally, we highlight a new relationship between the Frank-Wolfe gap for a problem with nonsmooth objective and the Frank-Wolfe gap for a smoothed surrogate problem, demonstrating suboptimality of prior analyses. Numerical experiments are performed for matrix factorization problems and nonconvex quadratic splitting over multiple convex constraint sets, where the improvements in analysis are empirically observed.
From: Antonio Silveti-Falls [view email]
[v1]
Sat, 30 May 2026 18:54:57 UTC (2,355 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。