journal article·2025-12-07Open access

Systematic Review of Reinforcement Learning in Process Industries: A Contextual and Taxonomic Approach

Marco Antonio Paz Ramos, Axel Busboom

Applied Sciences· Volume 15· Issue 24

Abstract

The process industry (PI) plays a vital role in the global economy and faces mounting pressure to enhance sustainability, operational agility, and resource efficiency amid tightening regulatory and market demands. Although artificial intelligence (AI) has been explored in this domain for decades, its adoption in industrial practice remains limited. Recently, machine learning (ML) has gained momentum, particularly when integrated with core PI systems such as process control, instrumentation, quality management, and enterprise platforms. Among ML techniques, reinforcement learning (RL) has emerged as a promising approach to tackle complex operational challenges. In contrast to conventional data-driven methods that focus on prediction or classification, RL directly addresses sequential decision making under uncertainty, a defining characteristic of dynamic process operations. Given RL’s growing relevance, this study conducts a systematic literature review to evaluate its current applications in the PI, assess methodological developments, and identify barriers to broader industrial adoption. The review follows the PRISMA methodology, a structured framework for identifying, screening, and selecting relevant publications. This approach ensures alignment with a clearly defined research question and minimizes bias, focusing on studies that demonstrate meaningful industrial applications of RL. The findings reveal that RL is transitioning from a theoretical construct to a practical tool, particularly in the chemical sector and for tasks such as process control and scheduling. Methodological maturity is improving, with algorithm selection increasingly tailored to problem-specific requirements and a trend toward hybrid models that integrate RL with established control strategies. However, most implementations remain confined to simulated environments, underscoring the need for real-world deployment, safety assurances, and improved interpretability. Overall, RL exhibits the potential to serve as a foundational component of next-generation smart manufacturing systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Process Optimization and Integration · Digital Transformation in Industry · Smart Grid Security and Resilience

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Engineering and Management, Munich University of Applied Sciences, 80335 Munich, Germany

Funding

Bavarian Ministry of Economic Affairs, Regional Development and Energy

References (100+)

Show source-provided references
1. Toward greener and smarter process industries10.1016/J.ENG.2017.02.010 ↗
2. A critical historical and scientific overview of all industrial revolutions10.1016/j.ifacol.2021.10.492 ↗
3. Paz-Ramos, M.A., and Busboom, A. (2025, January 9–12). Integration of Digital Twins with Reinforcement Learning in Industry: A Systematic Review. Proceedings of the 2025 IEEE 30th International Conference on Emerging Technologies and Factory Automation (ETFA), Porto, Portugal.10.1109/ETFA65518.2025.11205657 ↗
4. A review on reinforcement learning: Introduction and applications in industrial process control10.1016/j.compchemeng.2020.106886 ↗
5. Faria, R.D.R., Capron, B.D.O., Secchi, A.R., and De Souza, M.B.J. (2022). Where reinforcement learning meets process control: Review and guidelines. Processes, 10.10.3390/pr10112311 ↗
6. Reinforcement learning in process industries: Review and perspective10.1109/JAS.2024.124227 ↗
7. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1136/bmj.n71 ↗
8. Ezell, S.J., and Atkinson, R.D. (2024). Annual Report on the U.S. Manufacturing Economy: 2024, Technical Report NIST AMS 600-16.
9. Developing an understanding of lean thinking in process industries10.1080/09537287.2011.633576 ↗
10. Redefining the characteristics of process-industries: A design theory approach10.1016/j.jengtecman.2023.101748 ↗
11. Managing Innovation & Technology in the Process Industries: Current practices and future perspectives10.1016/j.proeng.2016.02.105 ↗
12. Making cereal not cars
13. Fundamental theories and key technologies for smart and optimal manufacturing in the process industry10.1016/J.ENG.2017.02.011 ↗
14. Pittman, P.H., and Awater, J.E. (2022). Process Manufacturing. ASCM Supply Chain Dictionary, Association for Supply Chain Management. [17th ed.].
15. United Nations Statistics Division (2008). International Standard Industrial Classification of All Economic Activities (ISIC), Rev. 4, United Nations. Available online: https://unstats.un.org/unsd/publication/seriesm/seriesm_4rev4e.pdf.
16. A brief history of automatic control10.1109/37.506394 ↗
17. I. On Governors10.1098/rspl.1867.0055 ↗
18. Advanced control using decomposition and simple elements10.1016/j.arcontrol.2023.100903 ↗
19. Just-in-time based soft sensors for process industries: A status report and recommendations10.1016/j.jprocont.2023.103025 ↗
20. The past of PID controllers10.1016/S1367-5788(01)00005-0 ↗
21. Rockwell Automation (2025). 10th Annual State of Smart Manufacturing Report, Rockwell Automation. Available online: https://www.rockwellautomation.com/en-us/capabilities/digital-transformation/state-of-smart-manufacturing.html.
22. Oil and Gas 4.0 era: A systematic review and outlook10.1016/j.compind.2019.06.007 ↗
23. Intelligent manufacturing for the process industry driven by industrial artificial intelligence10.1016/j.eng.2021.04.023 ↗
24. The enabling technologies for digitalization in the chemical process industry10.1016/j.dche.2024.100161 ↗
25. Brennan, D. (2020). Process Industry Economics: Principles, Concepts and Applications, Elsevier.10.1016/B978-0-12-819466-9.00001-8 ↗
26. A taxonomy of machine learning techniques
27. Russell, S.J., and Norvig, P. (2021). Artificial Intelligence: A Modern Approach, Pearson. Global Edition.
28. Reinforcement learning: A survey10.1613/jair.301 ↗
29. Deep reinforcement learning: A brief survey10.1109/MSP.2017.2743240 ↗
30. Mnih, V. (2013). Playing atari with deep reinforcement learning. arXiv.
31. Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., and Riedmiller, M. (2014, January 21–26). Deterministic policy gradient algorithms. Proceedings of the International Conference on Machine Learning, Beijing, China.
32. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv.
33. Gibbs, S. (2025, December 02). Google buys UK artificial intelligence startup DeepMind for £400m, The Guardian, Available online: https://www.theguardian.com/technology/2014/jan/27/google-acquires-uk-artificial-intelligence-startup-deepmind.
34. Mastering the game of go without human knowledge10.1038/nature24270 ↗
35. Sang-Hun, C. (2025, December 02). Google’s computer program beats Lee Sedol in Go tournament, The New York Times, Available online: https://www.nytimes.com/2016/03/16/world/asia/korea-alphago-vs-lee-sedol-go.html.
36. Kissinger, H. (2025, December 02). How the Enlightenment Ends, The Atlantic, Available online: https://www.theatlantic.com/magazine/archive/2018/06/henry-kissinger-ai-could-mean-the-end-of-human-history/559124/.
37. Achiam, J. (2025, December 02). A Taxonomy of RL Algorithms. Available online: https://spinningup.openai.com/en/latest/spinningup/rl_intro2.html.
38. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, The MIT Press. [2nd ed.].
39. Watkins, C.J.C.H. (1989). Learning from Delayed Rewards. [Ph.D. Thesis, King’s College].
40. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
41. Hausknecht, M.J., and Stone, P. (2015, January 11–12). Deep Recurrent Q-Learning for Partially Observable MDPs. Proceedings of the NIPS Deep Reinforcement Learning Workshop, Montreal, QC, Canada.
42. Rummery, G.A., and Niranjan, M. (1994). On-Line Q-Learning Using Connectionist Systems, Cambridge University Engineering Department. Technical Report CUED/F-INFENG/TR 166.
43. Mnih, V., Badia, A.P., Mirza, M., Graves, A., Lillicrap, T.P., Harley, T., Silver, D., and Kavukcuoglu, K. (2016, January 19–24). Asynchronous Methods for Deep Reinforcement Learning. Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA.
44. Schulman, J., Levine, S., Abbeel, P., Jordan, M.I., and Moritz, P. (2015, January 6–11). Trust Region Policy Optimization. Proceedings of the 32nd International Conference on Machine Learning, Lille, France.
45. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv.
46. Fujimoto, S., Hoof, H.v., and Meger, D. (2018, January 10–15). Addressing Function Approximation Error in Actor-Critic Methods. Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholm, Sweden.
47. Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018, January 10–15). Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholm, Sweden.
48. Janner, M., Fu, J., Zhang, M., and Levine, S. (2019, January 8–14). When to Trust Your Model: Model-Based Policy Optimization. Proceedings of the Advances in Neural Information Processing Systems 32 (NeurIPS 2019), Vancouver, BC, Canada.
49. Ha, D., and Schmidhuber, J. (2018). World Models. arXiv.
50. Salimans, T., Ho, J., Chen, X., Sidor, S., and Sutskever, I. (2017). Evolution Strategies as a Scalable Alternative to Reinforcement Learning. arXiv.
51. Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., and Mordatch, I. (2017, January 4–9). Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments. Proceedings of the Advances in Neural Information Processing Systems 30 (NeurIPS 2017), Long Beach, CA, USA.
52. Rashid, T., Samvelyan, M., Schroeder de Witt, C., Farquhar, G., Foerster, J.N., and Whiteson, S. (2018, January 10–15). QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning. Proceedings of the 35th International Conference on Machine Learning (ICML), Stockholm, Sweden.
53. Robust safe reinforcement learning control of unknown continuous-time nonlinear systems with state constraints and disturbances10.1016/j.jprocont.2023.103028 ↗
54. Yifei, Y., and Lakshminarayanan, S. (2022, January 7–9). Multi-agent reinforcement learning system for multiloop control of chemical processes. Proceedings of the 2022 IEEE International Symposium on Advanced Control of Industrial Processes (AdCONIP), Vancouver, BC, Canada.10.1109/AdCONIP55568.2022.9894204 ↗
55. Model-free safe reinforcement learning for chemical processes using Gaussian processes10.1016/j.ifacol.2021.08.292 ↗
56. Resilience-based explainable reinforcement learning in chemical process safety10.1016/j.compchemeng.2024.108849 ↗
57. A recurrent reinforcement learning strategy for optimal scheduling of partially observable job-shop and flow-shop batch chemical plants under uncertainty10.1016/j.compchemeng.2024.108748 ↗
58. Robust-optimization-guiding deep reinforcement learning for chemical material production scheduling10.1016/j.compchemeng.2024.108745 ↗
59. Wu, Z., Wang, Y., and Jia, L. (2022, January 25–27). A dynamic chemical production scheduling method based on reinforcement learning. Proceedings of the 2022 China Automation Congress (CAC), Xiamen, China.10.1109/CAC57257.2022.10055985 ↗
60. A deep reinforcement learning approach for chemical production scheduling10.1016/j.compchemeng.2020.106982 ↗
61. Bougie, N., Onishi, T., and Tsuruoka, Y. (2022, January 6–9). Local control is all you need: Decentralizing and coordinating reinforcement learning for large-scale process control. Proceedings of the 61st Annual Conference of the Society of Instrument and Control Engineers (SICE), Kumamoto, Japan.10.23919/SICE56594.2022.9905798 ↗
62. Data-efficient reinforcement learning from controller guidance with integrated self-supervision for process control10.1016/j.ifacol.2022.07.553 ↗
63. A study on the development of robust fault diagnostic system based on neuro-fuzzy scheme10.1016/S1474-6670(17)37555-9 ↗
64. Nonintrusive parameter adaptation of chemical process models with reinforcement learning10.1016/j.jprocont.2023.02.001 ↗
65. A reinforcement learning-based economic model predictive control framework for autonomous operation of chemical reactors10.1016/j.cej.2021.130993 ↗
66. Online reinforcement learning for a continuous space system with experimental validation10.1016/j.jprocont.2021.06.004 ↗
67. Alhazmi, K., and Sarathy, S.M. (2020, January 12–15). Continuous control of complex chemical reaction network with reinforcement learning. Proceedings of the 2020 European Control Conference (ECC), St. Petersburg, Russia.10.23919/ECC51009.2020.9143688 ↗
68. Reinforcement learning based on real-time iteration NMPC10.1016/j.ifacol.2020.12.1195 ↗
69. Quantitative comparison of reinforcement learning and data-driven model predictive control for chemical and biological processes10.1016/j.compchemeng.2023.108558 ↗
70. Development of neurocontrollers with evolutionary reinforcement learning10.1016/j.compchemeng.2005.05.027 ↗
71. Conradie, A.E., Miikkulainen, R., and Aldrich, C. (2002, January 12–17). Intelligent process control utilising symbiotic memetic neuro-evolution. Proceedings of the 2002 Congress on Evolutionary Computation. CEC’02 (Cat. No.02TH8600), Honolulu, HI, USA.
72. A novel deep ensemble reinforcement learning based control method for strip flatness in cold rolling steel industry10.1016/j.engappai.2024.108695 ↗
73. Reinforcement learning for industrial process control: A case study in flatness control in steel industry10.1016/j.compind.2022.103748 ↗
74. Offline reinforcement learning for industrial process control: A case study from steel industry10.1016/j.ins.2023.03.019 ↗
75. Deep reinforcement learning for maintenance optimization of a scrap-based steel production line10.1016/j.ress.2024.110199 ↗
76. Zhang, T., Zhou, F., Zhao, J., and Wang, W. (2020, January 23–25). Deep reinforcement learning for secondary energy scheduling in steel industry. Proceedings of the 2020 2nd International Conference on Industrial Artificial Intelligence (IAI), Shenyang, China.10.1109/IAI50351.2020.9262196 ↗
77. Processing parameters optimization in hot forging of AISI 4340 steel using instability map and reinforcement learning10.1016/j.jmrt.2023.01.106 ↗
78. Wang, Z., Wang, L., Han, Z., and Zhao, J. (2020, January 27–29). Multi-index evaluation based reinforcement learning method for cyclic optimization of multiple energy utilization in steel industry. Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China.10.23919/CCC50068.2020.9189540 ↗
79. Cho, S.H., Shin, W.J., Ahn, J., Joo, S., and Kim, H.J. (2024, January 13–17). Dynamic crane scheduling with reinforcement learning for a steel coil warehouse. Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan.10.1109/ICRA57147.2024.10610858 ↗
80. A deep reinforcement learning based multi-objective optimization for the scheduling of oxygen production system in integrated iron and steel plants10.1016/j.apenergy.2023.121332 ↗
81. DuAK: Reinforcement learning-based knowledge graph reasoning for steel surface defect detection10.1109/TASE.2023.3307588 ↗
82. Unlocking optimal performance and flow level control of three-phase separator based on reinforcement learning: A case study in Basra refinery10.1016/j.tsep.2024.102885 ↗
83. A reinforcement learning based large-scale refinery production scheduling algorithm10.1109/TASE.2023.3321612 ↗
84. Multi-objective genetic algorithm embedded with reinforcement learning for petrochemical melt-flow-index production scheduling10.1016/j.asoc.2024.111630 ↗
85. Reinforcement learning for soft sensor design through autonomous cross-domain data selection10.1016/j.compchemeng.2023.108209 ↗
86. Actor–critic reinforcement learning and application in developing computer-vision-based interface tracking10.1016/j.eng.2021.04.027 ↗
87. Fault-tolerant control for nonlinear offshore steel jacket platforms based on reinforcement learning10.1016/j.oceaneng.2021.110247 ↗
88. Supriya, M., Srilatha, K., Smitha, S.P., Oommen, S., Hemantha, C., and Sharath, N. (2023, January 3–5). Q-learning based reinforcement learning controller for concentration control of food preparation. Proceedings of the 2023 5th International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India.10.1109/ICIRCA57980.2023.10220591 ↗
89. Intelligent control based on reinforcement learning for batch thermal sterilization of canned foods10.3182/20080706-5-KR-1001.00603 ↗
90. Digital twin-driven real-time planning, monitoring, and controlling in food supply chains10.1016/j.techfore.2023.122799 ↗
91. New trends in the development and application of artificial intelligence in food processing10.1016/j.ifset.2024.103600 ↗
92. Optimal control of a rougher flotation cell using adaptive dynamic programming10.1016/j.ifacol.2018.09.387 ↗
93. Sample-efficient reinforcement learning with knowledge-embedded hybrid model for optimal control of mining industry10.1016/j.eswa.2024.124402 ↗
94. Multi-rate layered operational optimal control for large-scale industrial processes10.1109/TII.2021.3105487 ↗
95. Fidencio, A.X., Glasmachers, T., and Naro, D. (2021, January 21–23). Application of reinforcement learning to a mining system. Proceedings of the 2021 IEEE 19th World Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl’any, Slovakia.10.1109/SAMI50585.2021.9378663 ↗
96. Control of conventional continuous thickeners via proximal policy optimization10.1016/j.mineng.2024.108761 ↗
97. Applications of machine learning in antibody discovery, process development, manufacturing and formulation: Current trends, challenges, and opportunities10.1016/j.compchemeng.2024.108585 ↗
98. Lv, Q., Zhou, F., Liu, X., and Zhi, L. (2023). Artificial intelligence in small molecule drug discovery from 2018 to 2023: Does it really work?. Bioorg. Chem., 141.10.1016/j.bioorg.2023.106894 ↗
99. Materials discovery with extreme properties via reinforcement learning-guided combinatorial chemistry10.1039/D3SC05281H ↗
100. Deep reinforcement learning optimized double exponentially weighted moving average controller for chemical mechanical polishing processes10.1016/j.cherd.2023.07.049 ↗