S. V. Kozyrev·2024-12-17·via cs.LG updates on arXiv.org
Explanation of grokking (delayed generalization) in learning is given by modeling grokking by the stochastic gradient Langevin dynamics (Brownian motion) and applying the ideas of thermodynamics.