Abstract:In this work we present an efficient and practically implementable approach for the application of reinforcement learning (RL)-based control in chemical process systems. This is an area that has yet to widely adopt RL-based control largely due to inherent challenges in trusting RL algorithms and the time-consuming process of training reliable agents. To address these challenges, we leverage a class of RL algorithms termed Y-wise Affine Neural Network (YANN)- RL, which we have developed in our prior work (Braniff and Tian, 2025a). By strategically initializing actor and critic networks YANN-RL algorithms provide confident and interpretable starting points within control schemes. We apply this RL-based control approach to three different process engineering case studies publicly available on the PC-Gym library (Bloor et al., 2026): (i) a continuous stirred tank reactor (CSTR), (ii) a four-tank system, and (iii) a multistage extraction column. Our approach is compared to several popular RL algorithms (PPO, SAC, DDPG, and TD3) and is benchmarked against nonlinear model predictive control (NMPC). These case studies demonstrate that YANN-RL can greatly reduce the training time and data needed, can be deployed with confidence for chemical process systems, and can approach the performance of NMPC without the knowledge of a full nonlinear model.
| Comments: | Accepted for publication at the 23rd IFAC World Congress, 2026 |
| Subjects: | Systems and Control (eess.SY); Machine Learning (cs.LG); Optimization and Control (math.OC) |
| Cite as: | arXiv:2605.21211 [eess.SY] |
| (or arXiv:2605.21211v1 [eess.SY] for this version) | |
| https://doi.org/10.48550/arXiv.2605.21211 arXiv-issued DOI via DataCite (pending registration) |
From: Austin Braniff [view email]
[v1]
Wed, 20 May 2026 14:07:02 UTC (582 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。