Abstract:This research note identifies a previously overlooked distinction between multi-objective reinforcement learning (MORL), and more conventional single-objective reinforcement learning (RL). It has previously been noted that the optimal policy for an MORL agent with a non-linear utility function is required to be conditioned on both the current environmental state and on some measure of the previously accrued reward. This is generally implemented by concatenating the observed state of the environment with the discounted sum of previous rewards to create an augmented state. While augmented states have been widely-used in the MORL literature, one implication of their use has not previously been reported -- namely that they require the agent to have continued access to the reward signal (or a proxy thereof) after deployment, even if no further learning is required. This note explains why this is the case, and considers the practical repercussions of this requirement.
| Subjects: | Machine Learning (cs.LG) |
| Cite as: | arXiv:2604.15757 [cs.LG] |
| (or arXiv:2604.15757v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2604.15757 arXiv-issued DOI via DataCite (pending registration) |
From: Peter Vamplew [view email]
[v1]
Fri, 17 Apr 2026 07:01:24 UTC (73 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。