journal article·2025-10-09Open access

Industrial Scheduling in the Digital Era: Challenges, State-of-the-Art Methods, and Deep Learning Perspectives

Alina Itu

Applied Sciences· Volume 15· Issue 19

Abstract

Industrial scheduling plays a central role in Industry 4.0, where efficiency, robustness, and adaptability are essential for competitiveness. This review surveys recent advances in reinforcement learning, digital twins, and hybrid artificial intelligence (AI)–operations research (OR) approaches, which are increasingly used to address the complexity of flexible job-shop and distributed scheduling problems. We focus on how these methods compare in terms of scalability, robustness under uncertainty, and integration with industrial IT systems. To move beyond an enumerative survey, the paper introduces a structured analysis in three domains: comparative strengths and limitations of different approaches, ready-made tools and integration capabilities, and representative industrial case studies. These cases, drawn from recent literature, quantify improvements such as reductions in makespan, tardiness, and cycle time variability, or increases in throughput and schedule stability. The review also discusses critical challenges, including data scarcity, computational cost, interoperability with Enterprise Resource Planning (ERP)/Manufacturing Execution System (MES) platforms, and the need for explainable and human-in-the-loop frameworks. By synthesizing methodological advances with industrial impact, the paper highlights both the potential and the limitations of current approaches and outlines key directions for future research in resilient, data-driven production scheduling.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Scheduling and Optimization Algorithms · Digital Transformation in Industry · Advanced Manufacturing and Logistics Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Automation and Information Technology, Transilvania University of Brasov, Mihai Viteazu nr. 5, 5000174 Brasov, Romania

Funding

Ministry of Research, Innovation and Digitization, CNCS/CCCDI—UEFISCDI

References (100+)

Show source-provided references
1. Pinedo, M.L. (2016). Scheduling: Theory, Algorithms, and Systems, Springer. [5th ed.].
2. A survey of scheduling problems with setup times or costs10.1016/j.ejor.2006.06.060 ↗
3. Flowshop scheduling research after five decades10.1016/j.ejor.2005.02.001 ↗
4. Blazewicz, J., Ecker, K.H., Pesch, E., Schmidt, G., and Weglarz, J. (2007). Handbook on Scheduling: From Theory to Applications, Springer. Available online: https://link.springer.com/book/10.1007/978-3-540-32220-7.
5. Optimization and Approximation in Deterministic Sequencing and Scheduling: A Survey10.1016/S0167-5060(08)70356-X ↗
6. Garey, M.R., and Johnson, D.S. (1979). Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman & Co.. Available online: https://perso.limos.fr/~palafour/PAPERS/PDF/Garey-Johnson79.pdf.
7. Machine Learning for Combinatorial Optimization: A Methodological Tour d’Horizon10.1016/j.ejor.2020.07.063 ↗
8. Digital twin-enhanced dynamic job-shop scheduling10.1016/j.jmsy.2020.04.008 ↗
9. Herrmann, J.W. (2006). Handbook of Production Scheduling, Springer.10.1007/0-387-33117-4 ↗
10. Energy-efficient scheduling in manufacturing companies: A review and research framework10.1016/j.ejor.2015.07.017 ↗
11. Implementing smart factory of Industrie 4.0: An outlook10.1155/2016/3159805 ↗
12. Cyber-physical systems in manufacturing10.1016/j.cirp.2016.06.005 ↗
13. Intelligent manufacturing in the context of Industry 4.0: A review10.1016/J.ENG.2017.05.015 ↗
14. A digital supply chain twin for managing the disruption risks and resilience in the era of Industry 4.010.1080/09537287.2020.1768450 ↗
15. A new approach to scheduling in manufacturing for power consumption and carbon footprint reduction10.1016/j.jmsy.2011.08.004 ↗
16. The Operator 4.0: Towards socially sustainable factories of the future10.1016/j.cie.2019.106128 ↗
17. OR-methods for coping with the ripple effect in supply chains during COVID-19: Managerial insights and research implications10.1016/j.ijpe.2020.107921 ↗
18. Khalil, E.B., Le Bodic, P., Song, L., Nemhauser, G., and Dilkina, B. (2016, January 12–17). Learning to Branch in Mixed Integer Programming. Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI), Phoenix, AZ, USA. Available online: https://ojs.aaai.org/index.php/AAAI/article/view/10080.10.1609/aaai.v30i1.10080 ↗
19. Gasse, M., Chételat, D., Ferroni, N., Charlin, L., and Lodi, A. (2019, January 8–14). Exact Combinatorial Optimization with Graph Convolutional Neural Networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada. Available online: https://arxiv.org/abs/1906.01629.
20. Vinyals, O., Fortunato, M., and Jaitly, N. (2015, January 7–12). Pointer Networks. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, QC, Canada. Available online: https://arxiv.org/abs/1506.03134.
21. Kool, W., van Hoof, H., and Welling, M. (2018). Attention, Learn to Solve Routing Problems!. arXiv.
22. Zhang, C., Song, W., Cao, Z., Zhang, J., Tan, P.S., and Xu, C. (2020). Learning to dispatch for job-shop scheduling via deep reinforcement learning. arXiv.
23. The price of robustness10.1287/opre.1030.0065 ↗
24. Rescheduling manufacturing systems: A framework of strategies, policies, and methods10.1023/A:1022235519958 ↗
25. A survey of dynamic scheduling in manufacturing systems10.1007/s10951-008-0090-8 ↗
26. Deep Reinforcement Learning in Production Systems: A Systematic Literature Review10.1080/00207543.2021.1973138 ↗
27. Deep reinforcement learning-based dynamic scheduling for resilient and sustainable manufacturing: A systematic review10.1016/j.jmsy.2024.10.026 ↗
28. Zhang, F., Bai, J., Yang, D., and Wang, Q. (2022). Digital twin data-driven proactive job-shop scheduling strategy towards asymmetric manufacturing execution decision. Sci. Rep., 12.10.1038/s41598-022-05304-w ↗
29. Digital Twin Shop-Floor: A New Shop-Floor Paradigm Towards Smart Manufacturing10.1109/ACCESS.2017.2756069 ↗
30. Industry 4.0: State of the art and future trends10.1080/00207543.2018.1444806 ↗
31. Yang, C., Wang, X., Lu, Y., Liu, H., Le, Q.V., Zhou, D., and Chen, X. (2024, January 7–11). Large Language Models as Optimizers (OPRO). Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria. Available online: https://openreview.net/forum?id=Bb4VGOWELI.
32. Metaheuristics in combinatorial optimization: Overview and conceptual comparison10.1145/937503.937505 ↗
33. Effective and interpretable dispatching rules for dynamic job shops via guided empirical learning10.1016/j.omega.2022.102643 ↗
34. Neural large neighborhood search for routing problems10.1016/j.artint.2022.103786 ↗
35. Graph neural networks for job shop scheduling problems: A survey10.1016/j.cor.2024.106914 ↗
36. Logic-based Benders decomposition for the preemptive flexible job-shop scheduling problem10.1016/j.cor.2023.106156 ↗
37. Critical-path-search logic-based Benders decomposition approaches for flexible job shop scheduling
38. Combining optimisation and simulation using logic-based Benders decomposition10.1016/j.ejor.2023.07.032 ↗
39. Multicut logic-based Benders decomposition for discrete-time scheduling and dynamic optimization of network batch plants10.1002/aic.18491 ↗
40. Bestuzheva, K., Besançon, M., Chen, W.-K., Chmiela, A., Donkiewicz, T., van Doornmalen, J., Eifler, L., Gaul, O., Gamrath, G., and Gleixner, A. (2021). The SCIP Optimization Suite 8.0. arXiv.
41. Progress in mathematical programming solvers from 2001 to 202010.1016/j.ejco.2022.100031 ↗
42. Reinforcement learning and digital twin-based real-time scheduling method in intelligent manufacturing systems10.1016/j.ifacol.2022.09.413 ↗
43. Learning to select cuts for efficient mixed-integer programming10.1016/j.patcog.2021.108353 ↗
44. Wang, Z., Li, X., Wang, J., Kuang, Y., Yuan, M., Zeng, J., Zhang, Y., and Wu, F. (2023). Learning cut selection for mixed-integer linear programming via hierarchical sequence model. arXiv.
45. Tang, Y., Agrawal, S., and Faenza, Y. (2020, January 13–18). Reinforcement Learning for Integer Programming: Learning to Cut. Proceedings of the 37th International Conference on Machine Learning (ICML 2020), Online.
46. Nair, V., Bartunov, S., Gimeno, F., von Glehn, I., Lichocki, P., Lobov, I., O’Donoghue, B., Sonnerat, N., Tjandraatmadja, C., and Wang, P. (2020). Solving mixed integer programs using neural networks. arXiv.
47. Mönch, L., Fowler, J.W., and Mason, S.J. (2013). Production Planning and Control for Semiconductor Wafer Fabrication Facilities: Modeling, Analysis, and Systems, Springer.10.1007/978-1-4614-4472-5 ↗
48. A Survey on Industrial Internet of Things: A Cyber-Physical Systems Perspective10.1109/ACCESS.2018.2884906 ↗
49. Park, K.T., Son, Y.H., Ko, S.W., and Noh, S.D. (2021). Digital twin and reinforcement learning-based resilient production control for micro smart factory. Appl. Sci., 11.10.3390/app11072977 ↗
50. Viability of intertwined supply networks: Extending the supply chain resilience angles toward survivability10.1080/00207543.2020.1750727 ↗
51. Kouvelis, P., and Yu, G. (1997). Robust Discrete Optimization and Its Applications, Springer.10.1007/978-1-4757-2620-6 ↗
52. Min–max and min–max regret versions of combinatorial optimization problems: A survey10.1016/j.ejor.2008.09.012 ↗
53. Adjustable robust solutions of uncertain linear programs10.1007/s10107-003-0454-y ↗
54. An adaptive robust optimization model for parallel machine scheduling10.1016/j.ejor.2022.07.018 ↗
55. An adjustable robust optimization model for the resource-constrained project scheduling problem with uncertain activity durations10.1016/j.omega.2016.09.009 ↗
56. Birge, J.R., and Louveaux, F. (2011). Introduction to Stochastic Programming, Springer. [2nd ed.].10.1007/978-1-4614-0237-4 ↗
57. Zhang, T., Xie, S., and Rose, O. (2017, January 3–6). Real-time job shop scheduling based on simulation and Markov decision processes. Proceedings of the 2017 Winter Simulation Conference (WSC), Las Vegas, NV, USA.10.1109/WSC.2017.8248100 ↗
58. Puterman, M.L. (2005). Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley. [2nd ed.].
59. Realtime scheduling heuristics for just-in-time production in large-scale flexible job shops10.1016/j.jmsy.2022.01.006 ↗
60. Smart manufacturing scheduling: A literature review10.1016/j.jmsy.2021.09.011 ↗
61. Automation platform independent multi-agent system for robust networks of production resources in Industry 4.010.1007/s10845-021-01759-2 ↗
62. Industrial automation based on cyber-physical systems technologies: Prototype implementations and challenges10.1016/j.compind.2015.08.004 ↗
63. Deep reinforcement learning based scheduling within production plan in semiconductor fabrication10.1016/j.eswa.2021.116222 ↗
64. Sustainability in manufacturing operations scheduling: A state of the art review10.1016/j.jmsy.2015.08.002 ↗
65. Wang, W., Zhang, Y., Wang, Y., Pan, G., and Feng, Y. (2025). Hierarchical multi-agent deep reinforcement learning for dynamic flexible job-shop scheduling with transportation. Int. J. Prod. Res., 1–28.10.1080/00207543.2025.2511239 ↗
66. Mourtzis, D. (2022). Advances in Adaptive Scheduling in Industry 4.0. Front. Manuf. Technol., 2.10.3389/fmtec.2022.937889 ↗
67. Xu, W., Gu, J., Zhang, W., Gen, M., and Ohwada, H. (2025). Multi-agent reinforcement learning for flexible job shop scheduling: A review. Front. Ind. Eng., 2.10.3389/fieng.2025.1611512 ↗
68. Smart manufacturing must embrace big data10.1038/544023a ↗
69. Anthropocentric perspective of production before and within Industry 4.010.1016/j.cie.2019.01.018 ↗
70. Song, L., Li, Y., and Xu, J. (2023). Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning. Processes, 11.10.3390/pr11123434 ↗
71. DeepMAG: Multi-agent graph reinforcement learning for dynamic job shop scheduling10.1016/j.knosys.2022.110083 ↗
72. Digital Twin-driven smart manufacturing: Connotation, reference model, applications and research issues10.1016/j.rcim.2019.101837 ↗
73. Digital Twin in manufacturing: A categorical literature review and classification
74. The Digital Twin: Demonstrating the potential of real-time data acquisition in production systems10.1016/j.promfg.2017.04.043 ↗
75. A holonic multi-agent methodology to design sustainable intelligent manufacturing control systems10.1016/j.jclepro.2017.03.079 ↗
76. Dynamic production scheduling towards self-organizing mass personalization: A multi-agent dueling deep reinforcement learning approach10.1016/j.jmsy.2023.03.003 ↗
77. Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems10.1016/j.rcim.2022.102412 ↗
78. Qin, Z., and Lu, Y. Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing. J. Intell. Manuf., 2024.10.1007/s10845-024-02494-0 ↗
79. Dynamic flexible flow shop scheduling via cross-attention networks and multi-agent reinforcement learning10.1016/j.jmsy.2025.03.005 ↗
80. Malucelli, N., Domini, D., Aguzzi, G., and Viroli, M. (April, January 31). Neighbor-Based Decentralized Training Strategies for Multi-Agent Reinforcement Learning. Proceedings of the 40th ACM/SIGAPP Symposium on Applied Computing (SAC ’25), Catania, Italy.
81. Beregi, R., Németh, D., Turek, P., Monostori, L., and Váncza, J. (2021). Manufacturing Execution System Integration through the Standardization of a Common Service Model for Cyber-Physical Production Systems. Appl. Sci., 11.10.3390/app11167581 ↗
82. Architecture for Manufacturing-X: Bringing Asset Administration Shell, Eclipse Dataspace Connector and OPC UA together10.1016/j.mfglet.2023.05.002 ↗
83. Trunzer, E., Vogel-Heuser, B., Chen, J.-K., and Kohnle, M. (2021). Model-Driven Approach for Realization of Data Collection Architectures for Cyber-Physical Systems of Systems to Lower Manual Implementation Efforts. Sensors, 21.10.3390/s21030745 ↗
84. Making knowledge graphs work for smart manufacturing: Research topics, applications and prospects10.1016/j.jmsy.2024.07.009 ↗
85. Cindrić, I., Jurčević, M., and Hadjina, T. (2025). Mapping of Industrial IoT to IEC 62443 Standards. Sensors, 25.10.3390/s25030728 ↗
86. National Institute of Standards and Technology (NIST) (2023). Guide to Operational Technology (OT) Security.
87. A survey on data provenance in IoT10.1007/s11280-019-00746-1 ↗
88. Umer, M.A., Umer, M., Pandey, M., and Abdulla, S. (2024). Leveraging Artificial Intelligence and Provenance Blockchain Framework to Mitigate Risks in Cloud Manufacturing in Industry 4.0. Electronics, 13.10.3390/electronics13030660 ↗
89. A digital twin to train deep reinforcement learning agent for smart manufacturing plants: Environment, interfaces and intelligence10.1016/j.jmsy.2020.06.012 ↗
90. Digital twin-based job shop anomaly detection and dynamic scheduling10.1016/j.rcim.2022.102443 ↗
91. Study on edge-cloud collaborative production scheduling based on enterprises with multi-factory10.1109/ACCESS.2020.2972914 ↗
92. A framework of cloud–edge collaborated digital twin for flexible job shop scheduling with conflict-free routing10.1016/j.rcim.2023.102672 ↗
93. Siatras, V., Bakopoulos, E., Mavrothalassitis, P., Nikolakis, N., and Alexopoulos, K. (2024). Production Scheduling Based on a Multi-Agent System and Digital Twin: A Bicycle Industry Case. Information, 15.10.3390/info15060337 ↗
94. The impact of multiagent systems on autonomous production and supply chain networks: Use cases, barriers and contributions to logistics network resilience10.1108/SCM-07-2022-0282 ↗
95. Asset Administration Shell in Manufacturing: Applications and Relationship with Digital Twin
96. Deep reinforcement learning for dynamic scheduling of a flexible job shop10.1080/00207543.2022.2058432 ↗
97. Production scheduling in the context of Industry 4.0: Review and trends10.1080/00207543.2020.1718794 ↗
98. Scalable Scheduling of Semiconductor Packaging Facilities Using Deep Reinforcement Learning10.1109/TCYB.2021.3128075 ↗
99. A review of reinforcement learning-based intelligent optimization for manufacturing scheduling10.23919/CSMS.2021.0027 ↗
100. Kovács, B., Tassel, P., Gebser, M., and Seidel, G. (2022, January 11–14). A Customizable Reinforcement Learning Environment for Semiconductor Fab Simulation. Proceedings of the 2022 Winter Simulation Conference, Singapore.10.1109/WSC57314.2022.10015524 ↗