



























Abstract:Energy-based models (EBMs) are flexible generative architectures inspired by statistical physics, but their learning and generative properties remain poorly understood. Here, we analyze a solvable EBM in the high-dimensional limit: the spherical Boltzmann machine (SBM). Combining tools from random matrix theory and dynamical mean-field theory, we: solve exact equations describing the training dynamics of the SBM; compute the Bayesian evidence, which acts as a partition function in parameter space and encodes global properties of the trained model; and uncover cascades of phase transitions that occur both during training and as a function of hyperparameters, related to successive alignment and condensation of the top modes of the coupling matrix to the data. We connect these transitions to sampling-time generative phenomena in a teacher-student scenario, including: sampling temperature tuning, double descent as a function of regularization strength, tempered posterior effects, and out-of-equilibrium effects during training that induce biases in the trained model. We provide numerical evidence demonstrating that all these phenomena appear in standard generative architectures, beyond the SBM.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.09031 [cs.LG] |
| (or arXiv:2605.09031v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.09031 arXiv-issued DOI via DataCite (pending registration) |
From: Jorge Fernandez-De-Cossio-Diaz [view email]
[v1]
Sat, 9 May 2026 16:15:18 UTC (1,101 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。