journal article·2023-02-01Open access

Machine Learning in Manufacturing towards Industry 4.0: From ‘For Now’ to ‘Four-Know’

Tingting Chen, Vignesh Sampath, Marvin Carl May, Shuo Shan, Oliver Jonas Jorg, Juan José Aguilar Martín, Florian Stamer, Gualtiero Fantoni, Guido Tosello, Matteo Calaon

Applied Sciences· Volume 13· Issue 3

Abstract

While attracting increasing research attention in science and technology, Machine Learning (ML) is playing a critical role in the digitalization of manufacturing operations towards Industry 4.0. Recently, ML has been applied in several fields of production engineering to solve a variety of tasks with different levels of complexity and performance. However, in spite of the enormous number of ML use cases, there is no guidance or standard for developing ML solutions from ideation to deployment. This paper aims to address this problem by proposing an ML application roadmap for the manufacturing industry based on the state-of-the-art published research on the topic. First, this paper presents two dimensions for formulating ML tasks, namely, ’Four-Know’ (Know-what, Know-why, Know-when, Know-how) and ’Four-Level’ (Product, Process, Machine, System). These are used to analyze ML development trends in manufacturing. Then, the paper provides an implementation pipeline starting from the very early stages of ML solution development and summarizes the available ML methods, including supervised learning methods, semi-supervised methods, unsupervised methods, and reinforcement methods, along with their typical applications. Finally, the paper discusses the current challenges during ML applications and provides an outline of possible directions for future developments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Transformation in Industry · Industrial Vision Systems and Defect Detection · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil and Mechanical Engineering, Technical University of Denmark, 2800 Kongens Lyngby, Denmark

Autonomous and Intelligent Systems Unit, Tekniker, Member of Basque Research and Technology Alliance, 20600 Eibar, Spain

wbk Institute of Production Science, Karlsruhe Institute of Technology (KIT), Kaiserstr. 12, 76131 Karlsruhe, Germany

Department of Civil and Industrial Engineering, University of Pisa, 56122 Pisa, Italy

Department of Design and Manufacturing Engineering, School of Engineering and Architecture, University of Zarazoga, 50009 Zaragoza, Spain

Funding

European Training Network supported by Horizon 2020

References (100+)

Show source-provided references
1. Abele, E., and Reinhart, G. (2011). Zukunft der Produktion: Herausforderungen, Forschungsfelder, Chancen, Hanser.10.3139/9783446428058 ↗
2. Zizic, M.C., Mladineo, M., Gjeldum, N., and Celent, L. (2022). From industry 4.0 towards industry 5.0: A review and analysis of paradigm shift for the people, organization and technology. Energies, 15.10.3390/en15145221 ↗
3. Industry 5.0 and Society 5.0—Comparison, complementation and co-evolution10.1016/j.jmsy.2022.07.010 ↗
4. Vukovic, M., Mazzei, D., Chessa, S., and Fantoni, G. (2021, January 14–23). Digital Twins in Industrial IoT: A survey of the state of the art and of relevant standards. Proceedings of the 2021 IEEE International Conference on Communications Workshops (ICC Workshops), Montreal, QC, Canada.10.1109/ICCWorkshops50388.2021.9473889 ↗
5. Modelling and quantification of industry 4.0 manufacturing complexity based on information theory: A robotics case study10.1080/00207543.2019.1571686 ↗
6. Cobots and the benefits of their implementation in intelligent manufacturing10.1088/1757-899X/862/3/032075 ↗
7. Product Generation Module: Automated Production Planning for optimized workload and increased efficiency in Matrix Production Systems10.1016/j.procir.2021.01.050 ↗
8. Industry 4.0: A survey on technologies, applications and open research issues
9. Miqueo, A., Torralba, M., and Yagüe-Fabra, J.A. (2020). Lean manual assembly 4.0: A systematic review. Appl. Sci., 10.10.3390/app10238555 ↗
10. Machine learning in manufacturing: Advantages, challenges, and applications
11. Machine learning in manufacturing and industry 4.0 applications10.1080/00207543.2021.1956675 ↗
12. Machine Learning for industrial applications: A comprehensive literature review10.1016/j.eswa.2021.114820 ↗
13. Deep learning for smart manufacturing: Methods and applications10.1016/j.jmsy.2018.01.003 ↗
14. Machine learning and data mining in manufacturing10.1016/j.eswa.2020.114060 ↗
15. Alshangiti, M., Sapkota, H., Murukannaiah, P.K., Liu, X., and Yu, Q. (2019, January 19–20). Why is developing machine learning applications challenging? a study on stack overflow posts. Proceedings of the 2019 ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), Porto de Galinhas, Brazil.10.1109/ESEM.2019.8870187 ↗
16. Zeller, V., Hocken, C., and Stich, V. (2018, January 26–30). Acatech Industrie 4.0 maturity index—A multidimensional maturity model. Proceedings of the IFIP International Conference on Advances in Production Management Systems, Seoul, Republic of Korea.10.1007/978-3-319-99707-0_14 ↗
17. A nondestructive automatic defect detection method with pixelwise segmentation10.1016/j.knosys.2022.108338 ↗
18. A new graph-based semi-supervised method for surface defect classification10.1016/j.rcim.2020.102083 ↗
19. Machine Learning-Based Process-Level Fault Detection and Part-Level Fault Classification in Semiconductor Etch Equipment10.1109/TSM.2022.3161512 ↗
20. Reinforcement learning with Gaussian processes for condition-based maintenance10.1016/j.cie.2021.107321 ↗
21. Just-in-time semi-supervised soft sensor for quality prediction in industrial rubber mixers10.1016/j.chemolab.2018.07.002 ↗
22. Semi-supervised support vector regression based on self-training with label uncertainty: An application to virtual metrology in semiconductor manufacturing10.1016/j.eswa.2015.12.027 ↗
23. AHSS applications in Industry 4.0: Determination of optimum processing parameters during coiling process through unsupervised machine learning approach10.1016/j.mtcomm.2022.103625 ↗
24. Association rules and social network analysis for supporting failure mode effects and criticality analysis: Framework development and insights from an onshore platform10.1016/j.ssci.2022.105711 ↗
25. Pan, R., Li, X., and Chakrabarty, K. (2022, January 25–27). Semi-Supervised Root-Cause Analysis with Co-Training for Integrated Systems. Proceedings of the 2022 IEEE 40th VLSI Test Symposium (VTS), San Diego, CA, USA.10.1109/VTS52500.2021.9794192 ↗
26. Ontology-Driven Learning of Bayesian Network for Causal Inference and Quality Assurance in Additive Manufacturing10.1109/LRA.2021.3090020 ↗
27. A synergistic Mahalanobis–Taguchi system and support vector regression based predictive multivariate manufacturing process quality control approach10.1016/j.jmsy.2020.10.003 ↗
28. Enhancing manufacturing intelligence through an unsupervised data-driven methodology for cyclic industrial processes10.1016/j.eswa.2021.115269 ↗
29. A generic fault prognostics algorithm for manufacturing industries using unsupervised machine learning classifiers10.1016/j.simpat.2020.102109 ↗
30. Verstraete, D., Droguett, E., and Modarres, M. (2020, January 22–26). A deep adversarial approach based on multisensor fusion for remaining useful life prognostics. Proceedings of the 29th European Safety and Reliability Conference (ESREL 2019), Hannover, Germany.10.3850/978-981-11-2724-3_0302-cd ↗
31. A Comparative Study on Machine Learning Algorithms for Smart Manufacturing: Tool Wear Prediction Using Random Forests10.1115/1.4036350 ↗
32. Reinforcement Learning for Statistical Process Control in Manufacturing10.1016/j.measurement.2021.109616 ↗
33. Multi-agent deep reinforcement learning based Predictive Maintenance on parallel machines10.1016/j.rcim.2022.102406 ↗
34. Reinforcement learning for combined production-maintenance and quality control of a manufacturing system with deterioration failures10.1016/j.jmsy.2020.07.004 ↗
35. Liu, Y.H., Huang, H.P., and Lin, Y.S. (2005, January 1–2). Dynamic scheduling of flexible manufacturing system using support vector machines. Proceedings of the 2005 IEEE Conference on Automation Science and Engineering, IEEE-CASE 2005, Edmonton, AB, Canada.
36. An adaptive ensemble deep forest based dynamic scheduling strategy for low carbon flexible job shop under recessive disturbance10.1016/j.jclepro.2022.130541 ↗
37. Geometric transformation-based data augmentation on defect classification of segmented images of semiconductor materials using a ResNet50 convolutional neural network10.1016/j.eswa.2022.117731 ↗
38. AI based geometric similarity search supporting component reuse in engineering design10.1016/j.procir.2022.05.249 ↗
39. Multi-objective optimization of binder jet additive manufacturing of Co-Cr-Mo using machine learning10.1007/s00170-021-08183-z ↗
40. Jadidi, A., Mi, Y., Sikström, F., Nilsen, M., and Ancona, A. (2022). Beam Offset Detection in Laser Stake Welding of Tee Joints Using Machine Learning and Spectrometer Measurements. Sensors, 22.10.3390/s22103881 ↗
41. Machine learning to determine the main factors affecting creep rates in laser powder bed fusion10.1007/s10845-021-01785-0 ↗
42. Modeling of friction stir welding of aviation grade aluminium alloy using machine learning approaches10.1080/02286203.2020.1803605 ↗
43. Comparison of algorithms for error prediction in manufacturing with automl and a cost-based metric10.1007/s10845-021-01890-0 ↗
44. MeltpoolNet: Melt pool characteristic prediction in Metal Additive Manufacturing using machine learning
45. Self-optimizing tool path generation for 5-axis machining processes10.1016/j.cirpj.2018.11.005 ↗
46. Model predictive control of melt pool size for the laser powder bed fusion process under process uncertainty10.1115/1.4051746 ↗
47. A data-driven approach for tool wear recognition and quantitative prediction based on radar map feature fusion10.1016/j.measurement.2021.110072 ↗
48. Intelligent Fault Diagnosis for Bearings of Industrial Robot Joints Under Varying Working Conditions Based on Deep Adversarial Domain Adaptation
49. Applying Natural Language Processing in Manufacturing10.1016/j.procir.2022.10.071 ↗
50. A novel multi-scale CNN and attention mechanism method with multi-sensor signal for remaining useful life prediction10.1016/j.cie.2022.108204 ↗
51. Tool wear prediction in face milling of stainless steel using singular generative adversarial network and LSTM deep learning models10.1007/s00170-022-09356-0 ↗
52. Adaptive compensation of the transmission errors in rack-and-pinion drives10.1016/j.cirp.2022.03.026 ↗
53. An adaptive policy for on-line Energy-Efficient Control of machine tools under throughput constraint10.1016/j.jclepro.2020.125367 ↗
54. Score-Based Anomaly Detection for Smart Manufacturing Systems10.1109/TMECH.2022.3169724 ↗
55. Improved root cause analysis supporting resilient production systems10.1016/j.jmsy.2022.07.015 ↗
56. Productivity prediction in aircraft final assembly lines: Comparisons and insights in different productivity ranges10.1016/j.jmsy.2021.12.010 ↗
57. Reinforcement Learning Based Production Control of Semi-automated Manufacturing Systems10.1016/j.procir.2021.10.027 ↗
58. Multi-variate time-series for time constraint adherence prediction in complex job shops10.1016/j.procir.2021.10.008 ↗
59. Modelling and condition-based control of a flexible and hybrid disassembly system with manual and autonomous workstations using reinforcement learning10.1007/s10845-021-01863-3 ↗
60. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration10.1016/j.jclinepi.2009.06.006 ↗
61. A survey on generative adversarial networks for imbalance problems in computer vision tasks10.1186/s40537-021-00414-0 ↗
62. Data lifecycle challenges in production machine learning: A survey10.1145/3299887.3299891 ↗
63. Wang, Z., and Oates, T. (2015, January 25–31). Imaging time-series to improve classification and imputation. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina.
64. Lee, G., Flowers, M., and Dyer, M. (1989, January 18–22). Learning distributed representations of conceptual knowledge. Proceedings of the International 1989 Joint Conference on Neural Networks, Washington, DC, USA.10.1109/IJCNN.1989.118338 ↗
65. Converting tabular data into images for deep learning with convolutional neural networks10.1038/s41598-021-90923-y ↗
66. DeepInsight: A methodology to transform a non-image data to an image for convolution neural network architecture10.1038/s41598-019-47765-6 ↗
67. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
68. Handcrafted vs. non-handcrafted features for computer vision classification10.1016/j.patcog.2017.05.025 ↗
69. Alkinani, M.H., Khan, W.Z., Arshad, Q., and Raza, M. (2022). HSDDD: A Hybrid Scheme for the Detection of Distracted Driving through Fusion of Deep Learning and Handcrafted Features. Sensors, 22.10.3390/s22051864 ↗
70. Distilling the Knowledge from Handcrafted Features for Human Activity Recognition10.1109/TII.2018.2789925 ↗
71. Albawi, S., Mohammed, T.A., and Al-Zawi, S. (2017, January 21–23). Understanding of a convolutional neural network. Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey.10.1109/ICEngTechnol.2017.8308186 ↗
72. LIII. On lines and planes of closest fit to systems of points in space10.1080/14786440109462720 ↗
73. Independent component analysis, a new concept?10.1016/0165-1684(94)90029-9 ↗
74. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
75. Recurrent neural network based language model10.21437/Interspeech.2010-343 ↗
76. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns10.1109/TPAMI.2002.1017623 ↗
77. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
78. Dalal, N., and Triggs, B. (2005, January 20–26). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
79. The discrete wavelet transform: Wedding the a trous and Mallat algorithms10.1109/78.157290 ↗
80. Gröchenig, K. (2001). Foundations of Time-Frequency Analysis, Springer Science & Business Media.10.1007/978-1-4612-0003-1 ↗
81. Distributional structure10.1080/00437956.1954.11659520 ↗
82. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
83. Bringing AI to edge: From deep learning’s perspective10.1016/j.neucom.2021.04.141 ↗
84. Quantization10.1109/18.720541 ↗
85. Sampath, V., Maurtua, I., Aguilar Martín, J.J., Iriondo, A., Lluvia, I., and Rivera, A. (2022, January 20–22). Vision Transformer based knowledge distillation for fasteners defect detection. Proceedings of the 2022 International Conference on Electrical, Computer and Energy Technologies (ICECET), Prague, Czech Republic.10.1109/ICECET55527.2022.9872566 ↗
86. Decision Tree
87. Bagging predictors10.1007/BF00058655 ↗
88. Freund, Y., and Schapire, R.E. (1996, January 3–6). Experiments with a new boosting algorithm. Proceedings of the Thirteenth International Conference on International Conference on Machine Learning (ICML’96), Bari, Italy.
89. Ho, T.K. (1995, January 14–16). Random decision forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada.
90. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
91. A decision tree approach for identifying defective products in the manufacturing process
92. Feature selection using decision tree and classification through proximal support vector machine for fault diagnostics of roller bearing10.1016/j.ymssp.2006.05.004 ↗
93. Hung, Y.H. (2021). Improved ensemble-learning algorithm for predictive maintenance in the manufacturing process. Appl. Sci., 11.10.3390/app11156832 ↗
94. Marchuk, G.I. (1975). Optimization Techniques IFIP Technical Conference Novosibirsk, Novosibirsk, Russia, 1–7 July 1974, Springer.10.1007/3-540-07165-2 ↗
95. Statistical inference for probabilistic functions of finite state Markov chains10.1214/aoms/1177699147 ↗
96. A Bayesian framework to estimate part quality and associated uncertainties in multistage manufacturing10.1016/j.compind.2018.10.008 ↗
97. Patange, A.D., and Jegadeeshwaran, R. (2020). Application of bayesian family classifiers for cutting tool inserts health monitoring on CNC milling. Int. J. Progn. Health Manag., 11.10.36001/ijphm.2020.v11i2.2929 ↗
98. Application of Deep Transfer Learning and Uncertainty Quantification for Process Identification in Powder Bed Fusion10.1115/1.4051748 ↗
99. An integrated optimization of quality control chart parameters and preventive maintenance using Markov chain
100. El Haoud, N., and Bachiri, Z. (2019, January 12–14). Stochastic artificial intelligence benefits and supply chain management inventory prediction. Proceedings of the 2019 International Colloquium on Logistics and Supply Chain Management (LOGISTIQUA), Paris, France.10.1109/LOGISTIQUA.2019.8907271 ↗