journal article·2023-12-20Open access

Applying Learning and Self-Adaptation to Dynamic Scheduling

Bernhard Werth, Johannes Karder, Michael Heckmann, Stefan Wagner, Michael Affenzeller

Applied Sciences· Volume 14· Issue 1

Abstract

Real-world production scheduling scenarios are often not discrete, separable, iterative tasks but rather dynamic processes where both external (e.g., new orders, delivery shortages) and internal (e.g., machine breakdown, timing uncertainties, human interaction) influencing factors gradually or abruptly impact the production system. Solutions to these problems are often very specific to the application case or rely on simple problem formulations with known and stable parameters. This work presents a dynamic scheduling scenario for a production setup where little information about the system is known a priori. Instead of fully specifying all relevant problem data, the timing and batching behavior of machines are learned by a machine learning ensemble during operation. We demonstrate how a meta-heuristic optimization algorithm can utilize these models to tackle this dynamic optimization problem, compare the dynamic performance of a set of established construction heuristics and meta-heuristics and showcase how models and optimizers interact. The results obtained through an empirical study indicate that the interaction between optimization algorithm and machine learning models, as well as the real-time performance of the overall optimization system, can impact the performance of the production system. Especially in high-load situations, the dynamic algorithms that utilize solutions from previous problem epochs outperform the restarting construction heuristics by up to ~24%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Scheduling and Optimization Algorithms · Manufacturing Process and Optimization · Advanced Manufacturing and Logistics Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Campus Hagenberg, University of Applied Sciences Upper Austria, 4232 Hagenberg im Mühlkreis, Austria

Institute for Symbolic Artificial Intelligence, Johannes Kepler University Linz, 4040 Linz, Austria

Funding

Austrian Science Fund (FWF) · Austrian Federal Ministry for Digital and Economic Affairs · National Foundation for Research, Technology and Development · Christian Doppler Research Association

References (43)

Show source-provided references
1. Simulation research on job shop production10.1002/nav.3800040404 ↗
2. Dynamic job shop scheduling: A survey of simulation research10.1016/0305-0483(90)90017-4 ↗
3. Real-time production planning and control system for job-shop manufacturing: A system dynamics analysis10.1016/j.ejor.2011.07.022 ↗
4. Dynamic scheduling of multiproduct pipelines with multiple delivery due dates10.1016/j.compchemeng.2007.03.002 ↗
5. Dynamic scheduling of steel casting and milling using multi-agents10.1080/09537280410001662466 ↗
6. A Review of Dynamic Job Shop Scheduling Techniques10.1016/j.promfg.2019.02.006 ↗
7. Dynamic job-shop scheduling using reinforcement learning agents10.1016/S0921-8890(00)00087-7 ↗
8. A reinforcement learning approach to parameter estimation in dynamic job shop scheduling10.1016/j.cie.2017.05.026 ↗
9. Reinforcement learning in dynamic task scheduling: A review10.1007/s42979-020-00326-5 ↗
10. Lin, S.C., Goodman, E.D., and Punch, W.F. (1997, January 19–23). A genetic algorithm approach to dynamic job shop scheduling problem. Proceedings of the ICGA, East Lansing, MI, USA.
11. Hybrid genetic algorithms for minimizing makespan in dynamic job shop scheduling problem10.1016/j.cie.2016.03.011 ↗
12. An adaptive scheduling algorithm for dynamic jobs for dealing with the flexible job shop scheduling problem10.1007/s12599-019-00590-7 ↗
13. Tracking global optima in dynamic environments with efficient global optimization10.1016/j.ejor.2014.11.028 ↗
14. Intelligent scheduling with machine learning capabilities: The induction of scheduling knowledge10.1080/07408179208964213 ↗
15. A review of machine learning in scheduling10.1109/17.293383 ↗
16. A review of machine learning in dynamic scheduling of flexible manufacturing systems
17. A comparison of machine-learning algorithms for dynamic scheduling of flexible manufacturing systems10.1016/j.engappai.2005.09.009 ↗
18. Dynamic scheduling of manufacturing systems using machine learning: An updated review
19. Machine learning-based scheduling: A bibliometric perspective10.1049/cim2.12004 ↗
20. Job shop scheduling with a genetic algorithm and machine learning10.1080/002075497195605 ↗
21. Digital twin enhanced dynamic job-shop scheduling10.1016/j.jmsy.2020.04.008 ↗
22. Dynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning10.1016/j.asoc.2020.106208 ↗
23. Dynamic scheduling for stochastic edge-cloud computing environments using a3c learning and residual recurrent neural networks10.1109/TMC.2020.3017079 ↗
24. Petri-net-based dynamic scheduling of flexible manufacturing system via deep reinforcement learning with graph convolutional network10.1016/j.jmsy.2020.02.004 ↗
25. Deadlock-free scheduling method for flexible manufacturing systems based on timed colored Petri nets and anytime heuristic search10.1109/TSMC.2014.2376471 ↗
26. Lopez, V., Jokanovic, A., D’Amico, M., Garcia, M., Sirvent, R., and Corbalan, J. (2017, January 2). Djsb: Dynamic job scheduling benchmark. Proceedings of the Job Scheduling Strategies for Parallel Processing: 21st International Workshop, JSSPP 2017, Orlando, FL, USA.10.1007/978-3-319-77398-8_10 ↗
27. Beham, A., Leitner, S., Karder, J., Werth, B., and Wagner, S. (2022, January 9–13). Dynstack: A benchmarking framework for dynamic optimization problems in warehouse operations. Proceedings of the Genetic and Evolutionary Computation Conference Companion, Boston, MA, USA.10.1145/3520304.3533957 ↗
28. Beham, A., Kronberger, G., Karder, J., Kommenda, M., Scheibenpflug, A., Wagner, S., and Affenzeller, M. (2014, January 10–12). Integrated simulation and optimization in heuristiclab. Proceedings of the 26th European Modeling and Simulation Symposium EMSS 2014, Bordeaux, France.
29. Integrated machine learning in open-ended crane scheduling: Learning movement sSpeeds and service times10.1016/j.procs.2022.01.302 ↗
30. A survey on evolutionary constrained multiobjective optimization10.1109/TEVC.2022.3155533 ↗
31. A survey on evolutionary computation for complex continuous optimization10.1007/s10462-021-10042-y ↗
32. SASEGASA: An Evolutionary Algorithm for Retarding Premature Convergence by Self-Adaptive Selection Pressure Steering
33. Ribeiro, B., Albrecht, R.F., Dobnikar, A., Pearson, D.W., and Steele, N.C. (2007, January 11–14). Offspring selection: A new self-adaptive selection scheme for genetic algorithms. Proceedings of the Adaptive and Natural Computing Algorithms, 8th International Conference, ICANNGA 2007, Warsaw, Poland.
34. Segregative genetic algorithms (SEGA): A hybrid superstructure upwards compatible to genetic algorithms for retarding premature convergence
35. Karder, J., Werth, B., Beham, A., Wagner, S., and Affenzeller, M. (2022, January 20–25). Analysis and Handling of Dynamic Problem Changes in Open-Ended Optimization. Proceedings of the International Conference on Computer Aided Systems Theory, 18th International Conference, Las Palmas de Gran Canaria, Spain.10.1007/978-3-031-25312-6_7 ↗
36. Affenzeller, M., Wagner, S., and Winkler, S. (2007, January 12–16). Self-adaptive population size adjustment for genetic algorithms. Proceedings of the International Conference on Computer Aided Systems Theory, 1th International Conference on Computer Aided Systems Theory, Las Palmas de Gran Canaria, Spain.
37. Balci, O., Sharda, R., and Zenios, S.A. (1992). Computer Science and Operations Research, Pergamon.
38. Four decades of research on the open-shop scheduling problem to minimize the makespan10.1016/j.ejor.2021.03.026 ↗
39. Efficiency of the solution representations for the hybrid flow shop scheduling problem with makespan objective10.1016/j.cor.2019.05.002 ↗
40. Adjustment of an inverse matrix corresponding to changes in the elements of a given column or a given row of the original matrix
41. A generalized inverse for matrices10.1017/S0305004100030401 ↗
42. A review of L = λW and extensions10.1007/BF01158466 ↗
43. Variable neighborhood search10.1016/S0305-0548(97)00031-2 ↗