






























Abstract:Reinforcement learning is one of the most challenging learning paradigms where efficacy and efficiency gains are extremely valuable. Hierarchical reinforcement learning is a variant that leverages temporal abstraction to structure decision-making. While parametrized quantum computations have shown success in non-hierarchical reinforcement learning, whether these advantages adapt to hierarchical decision-making remains a critical open question. In this work, we develop a hybrid hierarchical agent based on the option-critic architecture. This hybrid agent substitutes classical components with variational quantum circuits for feature extractors, option-value functions, termination functions, and intra-option policies. Evaluated on standard benchmarking environments, results show that a hybrid agent utilizing a quantum feature extractor can outperform classical baselines while saving up to 66\% trainable parameters. We also identify an architectural bottleneck that quantum option-value estimation severely degrades performance. Further ablation studies reveal how architectural choices of the quantum circuits affect performance. Our work establishes design principles for parameter-efficient hybrid hierarchical agents.
| Subjects: | Machine Learning (cs.LG); Quantum Physics (quant-ph) |
| Cite as: | arXiv:2605.03434 [cs.LG] |
| (or arXiv:2605.03434v1 [cs.LG] for this version) | |
| https://doi.org/10.48550/arXiv.2605.03434 arXiv-issued DOI via DataCite (pending registration) |
From: Yu-Ting Lee [view email]
[v1]
Tue, 5 May 2026 07:14:53 UTC (5,787 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。