Abstract:We propose an iterative Gaussianization method for sampling from unnormalized densities by repeatedly applying mean-field variational inference (MFVI) in rotated coordinate systems. At each iteration, the method selects a rotation, solves an MFVI subproblem in the rotated coordinates, and applies the inverse coordinatewise map to transform the current target closer to the standard Gaussian. The resulting algorithm provides a computationally efficient way to construct flow-like transport maps: it requires only MFVI subproblems, avoids large-scale optimization, and produces transformations that are easy to invert and evaluate.
The effectiveness of the procedure depends on selecting informative rotations. We develop an efficient PCA-type method that chooses rotations from the leading eigenvectors of a cross-covariance matrix involving the target's score function. Experiments on Bayesian posterior sampling tasks show that performing MFVI in the proposed PCA-rotated coordinate systems substantially improves over standard MFVI, and that the resulting iterative Gaussianization procedure provides accurate flow-like approximations at lower computational cost than conventional normalizing-flow variational approximations.
From: Sifan Liu [view email]
[v1]
Thu, 9 Oct 2025 03:13:44 UTC (288 KB)
[v2]
Thu, 9 Jul 2026 11:39:34 UTC (486 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。