Choosing Solution Strategies for Scheduling Automated Guided Vehicles in Production Using Machine Learning
Source abstract
Abstract
Artificial intelligence is considered to be a significant technology for driving the future evolution of smart manufacturing environments. At the same time, automated guided vehicles (AGVs) play an essential role in manufacturing systems due to their potential to improve internal logistics by increasing production flexibility. Thereby, the productivity of the entire system relies on the quality of the schedule, which can achieve production cost savings by minimizing delays and the total makespan. However, traditional scheduling algorithms often have difficulties in adapting to changing environment conditions, and the performance of a selected algorithm depends on the individual scheduling problem. Therefore, this paper aimed to analyze the scheduling problem classes of AGVs by applying design science research to develop an algorithm selection approach. The designed artifact addressed a catalogue of characteristics that used several machine learning algorithms to find the optimal solution strategy for the intended scheduling problem. The contribution of this paper is the creation of an algorithm selection method that automatically selects a scheduling algorithm, depending on the problem class and the algorithm space. In this way, production efficiency can be increased by dynamically adapting the AGV schedules. A computational study with benchmark literature instances unveiled the successful implementation of constraint programming solvers for solving JSSP and FJSSP scheduling problems and machine learning algorithms for predicting the most promising solver. The performance of the solvers strongly depended on the given problem class and the problem instance. Consequently, the overall production performance increased by selecting the algorithms per instance. A field experiment in the learning factory at Reutlingen University enabled the validation of the approach within a running production scenario.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Scheduling and Optimization Algorithms · Advanced Manufacturing and Logistics Optimization · Assembly Line Balancing Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
ESB Business School, Reutlingen University, 72762 Reutlingen, Germany
Department of Industrial Engineering, Stellenbosch University, Stellenbosch 7600, South Africa
Funding
Baden-Württemberg Ministry of Science, Research, and Arts
References (68)
Show source-provided references
1. Albach, H., Meffert, H., Pinkwart, A., and Reichwald, R. (2015). Change Through Digitization—Value Creation in the Age of Industry 4.0. Management of Permanent Change, Springer Fachmedien Wiesbaden.10.1007/978-3-658-05014-6 ↗
2. Planning and control of autonomous mobile robots for intralogistics: Literature review and research agenda10.1016/j.ejor.2021.01.019 ↗
3. Survey of research in the design and control of automated guided vehicle systems10.1016/j.ejor.2004.09.020 ↗
4. A dynamic scheduling method for self-organized AGVs in production logistics systems10.1016/j.procir.2021.11.064 ↗
5. Pinedo, M.L. (2016). Scheduling: Theory, Algorithms, and Systems, Springer International Publishing. [5th ed.].
6. Deep reinforcement learning based AGVs real-time scheduling with mixed rule for flexible shop floor in industry 4.010.1016/j.cie.2020.106749 ↗
7. Lawler, E.L., Lenstra, J.K., Rinnooy Kan, A.H., and Shmoys, D.B. (1993). Chapter 9 Sequencing and scheduling: Algorithms and complexity. Handbooks in Operations Research and Management Science: Logistics of Production and Inventory, Elsevier.10.1016/S0927-0507(05)80189-6 ↗
8. Methodologies to Optimize Automated Guided Vehicle Scheduling and Routing Problems: A Review Study10.1007/s10846-013-0003-8 ↗
9. Industrial-size job shop scheduling with constraint programming
10. Rubinoff, M., and Yovits, M.C. (1976). TThe Algorithm Selection Problem**This work was partially supported by the National Science Foundation through Grant GP-32940X. This chapter was presented as the George E. Forsythe Memorial Lecture at the Computer Science Conference, February 19, 1975, Washington, D. C. Advances in Computers, Elsevier.
11. Bessiere, C., de Raedt, L., Kotthoff, L., Nijssen, S., O’Sullivan, B., and Pedreschi, D. (2016). Algorithm Selection for Combinatorial Search Problems: A Survey. Data Mining and Constraint Programming: Foundations of a Cross-Disciplinary Approach, Springer International Publishing.10.1007/978-3-319-50137-6 ↗
12. An automatic algorithm selection approach for the multi-mode resource-constrained project scheduling problem10.1016/j.ejor.2013.08.021 ↗
13. Recent advances in selection hyper-heuristics10.1016/j.ejor.2019.07.073 ↗
14. A machine learning approach for efficient multi-dimensional integration10.1038/s41598-021-98392-z ↗
15. Machine learning at the service of meta-heuristics for solving combinatorial optimization problems: A state-of-the-art10.1016/j.ejor.2021.04.032 ↗
16. SATzilla: Portfolio-based Algorithm Selection for SAT10.1613/jair.2490 ↗
17. An algorithm selection approach for the flexible job shop scheduling problem: Choosing constraint programming solvers through machine learning10.1016/j.ejor.2022.01.034 ↗
18. Instance space analysis and algorithm selection for the job shop scheduling problem10.1016/j.cor.2021.105661 ↗
19. Design Science in Information Systems Research10.2307/25148625 ↗
20. Österle, H. (2010). Gestaltungsorientierte Wirtschaftsinformatik: Ein Plädoyer für Rigor und Relevanz, Infowerk.
21. Literature review as a research methodology: An overview and guidelines10.1016/j.jbusres.2019.07.039 ↗
22. Simultaneous Production and AGV Scheduling using Multi-Agent Deep Reinforcement Learning10.1016/j.procir.2021.11.257 ↗
23. A survey of dynamic scheduling in manufacturing systems10.1007/s10951-008-0090-8 ↗
24. Dynamic scheduling of manufacturing job shops using genetic algorithms10.1023/A:1011253011638 ↗
25. Mousavi, M., Yap, H.J., Musa, S.N., Tahriri, F., and Md Dawal, S.Z. (2017). Multi-objective AGV scheduling in an FMS using a hybrid of genetic algorithm and particle swarm optimization. PLoS ONE, 12.10.1371/journal.pone.0169817 ↗
26. A tabu search algorithm for simultaneous machine/AGV scheduling problem10.1080/00207543.2014.910628 ↗
27. Genetic algorithms and tabu search: Hybrids for optimization10.1016/0305-0548(93)E0023-M ↗
28. A Review on Representative Swarm Intelligence Algorithms for Solving Optimization Problems: Applications and Trends10.1109/JAS.2021.1004129 ↗
29. Tan, Y., and Shi, Y. (2021). An Intelligent Algorithm for AGV Scheduling in Intelligent Warehouses. Advances in Swarm Intelligence, Springer International Publishing.
30. An effective multi-objective evolutionary algorithm for solving the AGV scheduling problem with pickup and delivery10.1016/j.knosys.2021.106881 ↗
31. A multi-agent based approach to dynamic scheduling of machines and automated guided vehicles in manufacturing systems10.1016/j.asoc.2012.02.001 ↗
32. Rossi, F., van Beek, P., and Walsh, T. (2006). Chapter 2—Constraint-Based Scheduling and Planning. Foundations of Artificial Intelligence: Handbook of Constraint Programming, Elsevier.
33. Scheduling and routing of automated guided vehicles: A hybrid approach10.1016/j.cor.2005.07.004 ↗
34. Integrated production and material handling scheduling using mathematical programming and constraint programming10.1016/j.ejor.2005.02.077 ↗
35. Real-time Automated Guided vehicles scheduling with Markov Decision Process and Double Q-Learning algorithm10.1016/j.matpr.2022.04.522 ↗
36. Chen, C., Hu, Z.-H., and Wang, L. (2021). Scheduling of AGVs in Automated Container Terminal Based on the Deep Deterministic Policy Gradient (DDPG) Using the Convolutional Neural Network (CNN). JMSE, 9.10.3390/jmse9121439 ↗
37. A hybrid fuzzy-neural-based dynamic scheduling method for part feeding of mixed-model assembly lines10.1016/j.cie.2021.107794 ↗
38. A neural network based multi-state scheduling algorithm for multi-AGV system in FMS10.1016/j.jmsy.2022.06.017 ↗
39. A review on the self and dual interactions between machine learning and optimisation10.1007/s13748-019-00185-z ↗
40. Combining metaheuristics with mathematical programming, constraint programming and machine learning10.1007/s10479-015-2034-y ↗
41. Machine learning for combinatorial optimization: A methodological tour d’horizon10.1016/j.ejor.2020.07.063 ↗
42. Schaus, P. (2022). Solving the Extended Job Shop Scheduling Problem with AGVs—Classical and Quantum Approaches. Integration of Constraint Programming, Artificial Intelligence, and Operations Research, Springer International Publishing.
43. A Branch-and-Cut Algorithm for the Dial-a-Ride Problem10.1287/opre.1060.0283 ↗
44. The Current state of bounds on benchmark instances of the job-shop scheduling problem10.1007/s10951-017-0547-8 ↗
45. Muth, J.F., and Thompson, G.L. (1963). Probabilistic learning combinations of local job-shop scheduling rules. Industrial Scheduling, Prentice-Hall.
46. Lawrence, S. (1984). Resource Constrained Project Scheduling: An Experimental Investigation of Heuristic Scheduling Techniques, GSIA, Carnegie Mellon University.
47. The Shifting Bottleneck Procedure for Job Shop Scheduling10.1287/mnsc.34.3.391 ↗
48. A Computational Study of the Job-Shop Scheduling Problem10.1287/ijoc.3.2.149 ↗
49. New Search Spaces for Sequencing Problems with Application to Job Shop Scheduling10.1287/mnsc.38.10.1495 ↗
50. Manner, R., and Manderick, B. (1992). A Genetic Algorithm Applicable to Large-Scale Job-Shop Problems. Parallel Problem Solving from Nature, 2, Elsevier Science Publishers, BV.
51. Benchmarks for basic scheduling problems10.1016/0377-2217(93)90182-M ↗
52. A Computational Study of Shifting Bottleneck Procedures for Shop Scheduling Problems10.1023/A:1009627429878 ↗
53. Routing and scheduling in a flexible job shop by tabu search10.1007/BF02023073 ↗
54. Chambers, J.B., and Barnes, J.W. (1996). Tabu Search for the Flexible-Routing Job Shop Problem, The University of Texas. Technical Report Series ORP96-10, Graduate Program in Operations Research and Industrial Engineering.
55. An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search10.1023/A:1018930406487 ↗
56. Tabu search for the job-shop scheduling problem with multi-purpose machines10.1007/BF01719451 ↗
57. Strassl, S. (2020). Instance Space Analysis for the Job Shop Scheduling Problem. [Diploma Thesis, Technische Universität Wien].
58. The MiniZinc Challenge 2008–201310.1609/aimag.v35i2.2539 ↗
59. Google Developers (2022, October 03). Google OR-Tools. Available online: https://developers.google.com/optimization.
60. Machine learning: Trends, perspectives, and prospects10.1126/science.aaa8415 ↗
61. Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, MIT Press.
62. Induction of decision trees10.1007/BF00116251 ↗
63. Gong, D. (2022, October 05). Top 6 Machine Learning Algorithms for Classification: How to Build a Machine Learning Model Pipeline in Python. Available online: https://towardsdatascience.com/top-machine-learning-algorithms-for-classification-2197870ff501.
64. Oxborough, C., Cameron, E., Rao, A., Birchall, A., Townsend, A., and Westermann, C. (2022, December 19). Explainable AI Driving Business Value through Greater Understanding. Available online: https://www.pwc.co.uk/audit-assurance/assets/explainable-ai.pdf.
65. Behnke, D., and Geiger, M.J. (2012). Test Insances for the Flexible Job Shop Scheduling Problem with Work Centers, Helmut-Schmidt-University.
66. van Hoorn, J.J. (2022, December 18). Job Shop Instances and Solutions. Available online: http://jobshop.jjvh.nl.
67. Ranganathan, S., Gribskov, M., Nakai, K., and Schonbach, C. (2019). Cross-Validation. Encyclopedia of Bioinformatics and Computational Biology, Academic Press.
68. Hummel, V. (2022, August 08). ESB Logistics Learning Factory: The Authentic Learning, Research and Development Environment at ESB Business School. Available online: https://www.esb-business-school.de/en/research/training-and-research-centre-added-value-and-logistics-systems/research-infrastructure/werk150/.