





























Abstract:Measuring learning progress is essential for curiosity-driven exploration in reinforcement learning, but widely used signals such as prediction error often fail to distinguish meaningful, learnable patterns from random noise. This paper proposes Gradient-Momentum Coupling (GMC), a signal derived from optimization dynamics that quantifies how useful each sample's gradient is for ongoing learning by measuring its per-parameter normalized absolute product with the momentum from previous gradients. By leveraging momentum's natural filtering of noise and oscillations, GMC identifies samples that contribute to ongoing parameter updates. Controlled experiments demonstrate noise robustness and emergent curriculum learning, with the signal prioritizing tasks by learning speed rather than difficulty. Experiments on MiniGrid suggest that replacing prediction error with GMC within existing curiosity-driven architectures can improve robustness to observation noise.
| Comments: | 23 pages, 15 figures, preprint |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2605.05856 [cs.LG] |
| (or arXiv:2605.05856v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.05856 arXiv-issued DOI via DataCite (pending registration) |
From: Samuel Blad [view email]
[v1]
Thu, 7 May 2026 08:26:50 UTC (3,730 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。