journal article·2025-11-28Open access

Dynamic Flexible Job Shop Scheduling via an Adaptive Genetic Algorithm and Deep Learning

Zheng Zhang, Hanning Chen, Zhixue Wang, Jiatong Han

Applied Sciences· Volume 15· Issue 23

Abstract

To address the scheduling problem of dynamic flexible job shop, this study proposes a hybrid scheduling method that integrates an adaptive genetic algorithm, dynamic target smoothing, and a deep Q-network (DQN). The scheduling process is formulated as a Markov decision process, where a graph convolutional network (GCN) extracts feature representations from evolving job and machine states. The adaptive genetic algorithm dynamically generates target values, while the dynamic target smoothing mechanism—based on sliding windows or exponential smoothing—further stabilizes target updates and enhances training efficiency. Experiments on the Brandimarte benchmark with stochastic job arrivals show that the proposed method reduces makespan by up to 2.1% compared to the QNGA baseline. In addition, the integration of adaptive evolution and smoothed target learning provides more stable training and stronger adaptability to dynamic environments than the existing DQN-based approaches.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Scheduling and Optimization Algorithms · Resource-Constrained Project Scheduling · Optimization and Packing Problems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Artificial Intelligence, Tiangong University, 399 Binshui West Road, Xiqing District, Tianjin 300387, China

Faculty of Applied Science and Engineering, University of Toronto, 27 King’s College Cir, Toronto, ON M5S 1A1, Canada

References (36)

Show source-provided references
1. A research survey: Review of flexible job shop scheduling techniques10.1111/itor.12199 ↗
2. A survey of dynamic scheduling in manufacturing systems10.1007/s10951-008-0090-8 ↗
3. Deep reinforcement learning for dynamic flexible job shop scheduling problem considering variable processing times10.1016/j.jmsy.2023.09.009 ↗
4. Wu, Z., Fan, H., Sun, Y., and Peng, M. (2023). Efficient multi-objective optimization on dynamic flexible job shop scheduling using deep reinforcement learning approach. Processes, 11.10.3390/pr11072018 ↗
5. Reinforcement learning in dynamic job shop scheduling: A comprehensive review of AI-driven approaches in modern manufacturing
6. Momenikorbekandi, A., and Kalganova, T. (2025). Intelligent scheduling methods for optimisation of job shop scheduling problems in the manufacturing sector: A systematic review. Electronics, 14.10.3390/electronics14081663 ↗
7. Sangaiah, A.K., Suraki, M.Y., Sadeghilalimi, M., Bozorgi, S.M., Hosseinabadi, A.A.R., and Wang, J. (2019). A new meta-heuristic algorithm for solving the flexible dynamic job-shop problem with parallel machines. Symmetry, 11.10.3390/sym11020165 ↗
8. Deep reinforcement learning based agvs real-time scheduling with mixed rule for flexible shop floor in industry 4.010.1016/j.cie.2020.106749 ↗
9. Distributed real-time scheduling in cloud manufacturing by deep reinforcement learning10.1109/TII.2022.3178410 ↗
10. A double deep q-network framework for a flexible job shop scheduling problem with dynamic job arrivals and urgent job insertions10.1016/j.engappai.2024.108487 ↗
11. Deep reinforcement learning in production systems: A systematic literature review10.1080/00207543.2021.1973138 ↗
12. Deep reinforcement learning for dynamic scheduling of a flexible job shop10.1080/00207543.2022.2058432 ↗
13. Mixed-integer linear programming and constraint programming formulations for solving distributed flexible job shop scheduling problem10.1016/j.cie.2020.106347 ↗
14. Hybrid quantum particle swarm optimization and variable neighborhood search for flexible job-shop scheduling problem10.1016/j.jmsy.2024.02.007 ↗
15. Zhang, C., Song, W., Cao, Z., Zhang, J., Tan, P.S., and Xu, C. (2020, January 6–12). Learning to dispatch for job shop scheduling via deep reinforcement learning. Proceedings of the Advances in Neural Information Processing Systems 33 (NeurIPS 2020), Virtual.
16. Zeng, Y., Liao, Z., Dai, Y., Wang, R., Li, X., and Yuan, B. (2022). Hybrid intelligence for dynamic job-shop scheduling with deep reinforcement learning and attention mechanism. arXiv.
17. Reinforcement learning for adaptive scheduling in dynamic job shops
18. Adaptive scheduling for flexible job-shop production using reinforcement learning
19. Deep reinforcement learning with double q-learning and dueling network for dynamic job shop scheduling10.1016/j.asoc.2021.107317 ↗
20. A new genetic programming approach to evolving dispatching rules for dynamic multi-objective job shop scheduling
21. Interpretable dispatching rules for dynamic job shop scheduling via multi-tree genetic programming
22. Hybrid genetic programming and reinforcement learning approach for dynamic job shop scheduling
23. An adaptive hybrid genetic programming and deep reinforcement learning algorithm for dynamic job shop scheduling
24. Turgut, C.E., and Bozdag, E. (2020, January 14–18). Deep q-network model for dynamic job shop scheduling problem based on discrete event simulation. Proceedings of the 2020 Winter Simulation Conference (WSC), Orlando, FL, USA.10.1109/WSC48552.2020.9383986 ↗
25. Real-time data-driven dynamic scheduling for flexible job shop with insufficient transportation resources using hybrid deep q network
26. Yang, D., Shu, X., Yu, Z., Lu, G., Ji, S., Wang, J., and He, K. (2024). Dynamic flexible job shop scheduling based on deep reinforcement learning. Proc. Inst. Mech. Eng. Part B J. Eng. Manuf., 239.10.1177/09544054241272855 ↗
27. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
28. Kobayashi, T., and Ilboudo, W.E.L. (2020). t-soft update of target network for deep reinforcement learning. arXiv.10.1016/j.neunet.2020.12.023 ↗
29. Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing10.1007/s10845-024-02494-0 ↗
30. Liu, Y., Wang, W., Hu, Y., Hao, J., Chen, X., and Gao, Y. (2020, January 7–12). Multi-agent game abstraction via graph attention neural network. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i05.6211 ↗
31. Multi-agent reinforcement learning based on graph convolutional network for flexible job shop scheduling10.1007/s10845-022-02037-5 ↗
32. Wei, H., Li, S., Jiang, H., Hu, J., and Hu, J. (2018). Hybrid genetic simulated annealing algorithm for improved flow shop scheduling with makespan criterion. Appl. Sci., 8.10.3390/app8122621 ↗
33. An effective hybrid algorithm for multi-objective flexible job-shop scheduling problem10.1177/1687814018801442 ↗
34. A hybrid genetic algorithm with dual-segment encoding for flexible job shop scheduling problem
35. A three-segment encoding based genetic algorithm for dynamic flexible job-shop scheduling problem with transportation constraints
36. Evolutionary Trainer-Based Deep Q-Network for Dynamic Flexible Job-Shop Scheduling10.1109/TEVC.2024.3367181 ↗