


























Abstract:Safety remains an open problem in reinforcement learning (RL), especially during training. While safety filters are promising to address safe exploration, they are generally poorly suited for high-dimensional systems with unknown dynamics. We propose Dyna-style Safety Augmented Reinforcement Learning (Dyna-SAuR), a novel algorithm that learns both a scalable safety filter and a control policy using a learned uncertainty-aware dynamics model, while requiring minimal domain knowledge. The filter avoids failures and high uncertainty regions. Thus, better models expand the set of safe and certain states, reducing filter conservatism. We present the effectiveness of Dyna-SAuR on goal-reaching CartPole as well as MuJoCo Walker, reducing failures compared to state-of-the-art methods by 2 orders of magnitude.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2604.25508 [cs.LG] |
| (or arXiv:2604.25508v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2604.25508 arXiv-issued DOI via DataCite (pending registration) |
From: Artur Eisele [view email]
[v1]
Tue, 28 Apr 2026 11:14:00 UTC (3,996 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。