Abstract:Learning meaningful abstract models of Markov Decision Processes (MDPs) is crucial for improving generalization from limited data. In this work, we show how geometric priors can be imposed on the low-dimensional representation manifold of a learned transition model. We incorporate known symmetric structures via appropriate choices of the latent space and the associated group actions, which encode prior knowledge about invariances in the environment. In addition, our framework allows the embedding of additional unstructured information alongside these symmetries. We show experimentally that this leads to better predictions of the latent transition model than fully unstructured approaches, as well as better learning on downstream RL tasks, in environments with rotational and translational features, including in first-person views of 3D environments. Additionally, our experiments show that this leads to simpler and more disentangled representations. The full code is available on GitHub to ensure reproducibility.
| Comments: | 20 pages, 18 figures |
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2506.01529 [cs.LG] |
| (or arXiv:2506.01529v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2506.01529 arXiv-issued DOI via DataCite |
From: Thomas Delliaux [view email]
[v1]
Mon, 2 Jun 2025 10:43:18 UTC (10,039 KB)
[v2]
Tue, 19 May 2026 08:53:21 UTC (3,367 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。