


























Abstract:Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applicability remains largely confined to continuous action spaces. To address a broader range of offline RL settings, we extend flow matching to a general framework that supports discrete action spaces with multiple objectives. Specifically, we replace continuous flows with continuous-time Markov chains, trained using a Q-weighted flow matching objective. We then extend our design to multi-agent settings, mitigating the exponential growth of joint action spaces via a factorized conditional path. We theoretically show that, under idealized conditions, optimizing this objective recovers the optimal policy. Extensive experiments further demonstrate that our method performs robustly across diverse settings and benchmarks, including high-dimensional control, multi-agent games, and dynamically changing preferences over multiple objectives, while outperforming traditional offline RL methods in practical multi-modal decision-making scenarios. Our discrete framework can also be applied to continuous-control problems through action quantization, providing a flexible trade-off between representational complexity and performance.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2602.06138 [cs.LG] |
| (or arXiv:2602.06138v2 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2602.06138 arXiv-issued DOI via DataCite |
From: Fairoz Nower Khan [view email]
[v1]
Thu, 5 Feb 2026 19:13:44 UTC (327 KB)
[v2]
Wed, 13 May 2026 00:11:54 UTC (498 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。