journal article·2025-02-08Open access

Deep Learning Utilization for In-Line Monitoring of an Additive Co-Extrusion Process Based on Evaluation of Laser Profiler Data

Valentin Lang, Christian Thomas Ernst Herrmann, Mirco Fuchs, Steffen Ihlenfeldt

Applied Sciences· Volume 15· Issue 4

Abstract

Additive manufacturing is gaining importance in a number of application areas, and there is an increased demand for mechanically resilient components. A way to improve the mechanical properties of parts made of thermoplastics is by using reinforcing material. The study demonstrates the development of a monitoring procedure for a fused filament fabrication-based co-extrusion process for manufacturing wire-reinforced thermoplastic components. Test components in two variants are produced, and data acquisition is carried out with a laser line scanner. The collected data are employed to train deep neural networks to classify the printed layers, aiming for the deep neural networks to be able to classify four different classes and identify layers with insufficient quality. A dedicated convolutional neural network is designed taking into account various factors such as layer architecture, data pre-processing and optimization methods. Several network architectures, including transfer learning (based on VGG16 and ResNet50), with and without fine-tuning, are compared in terms of their performance based on the F1 score. Both the transfer learning model with ResNet50 and the fine-tuning model achieve an F1 score of 84% and 83%, respectively, for the decisive class ‘wire bad’ classifying inadequate reinforcement.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Additive Manufacturing Materials and Processes · Additive Manufacturing and 3D Printing Technologies · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Mechatronic Engineering, Faculty of Mechanical Engineering, Technische Universität Dresden (TUD), 01062 Dresden, Germany

Institute of Electronics and Biomedical Information Technology, Faculty of Engineering, Hochschule für Technik, Wirtschaft und Kultur (HTWK Leipzig), 04277 Leipzig, Germany

Fraunhofer Institute for Machine Tools and Forming Technology, 01187 Dresden, Germany

Funding

Federal Republic of Germany’s Ministry Bundesministerium für Wirtschaft und Klimaschutz (BMWK)/Federal Ministry for Economic Affairs and Climate Action

References (70)

Show source-provided references
1. Araújo, N., Pacheco, V., and Costa, L. (2021). Smart additive manufacturing: The path to the digital value chain. Technologies, 9.10.3390/technologies9040088 ↗
2. Bogers, M., Hadar, R., and Bilberg, A. (2015). Business Models for Additive Manufacturing: Exploring Digital Technologies, Consumer Roles, and Supply Chains. Technol. Forecast. Soc. Change, Available online: https://ssrn.com/abstract=2638054.
3. Economic implications of 3D printing: Market structure models in light of additive manufacturing revisited10.1016/j.ijpe.2015.02.020 ↗
4. Intelligent machine learning based total productive maintenance approach for achieving zero downtime in industrial machinery10.1016/j.cie.2021.107267 ↗
5. Using machine learning and deep learning algorithms for downtime minimization in manufacturing systems: An early failure detection diagnostic service10.1007/s00170-023-12020-w ↗
6. Process monitoring, diagnosis and control of additive manufacturing10.1109/TASE.2022.3215258 ↗
7. Costs and cost effectiveness of additive manufacturing
8. The disruptive impact of additive manufacturing on supply chains: A literature study, conceptual framework and research agenda10.1016/j.compind.2019.07.003 ↗
9. Sustainability of additive manufacturing: An overview on its energy demand and environmental impact
10. The status, challenges, and future of additive manufacturing in engineering10.1016/j.cad.2015.04.001 ↗
11. Additive manufacturing: Scientific and technological challenges, market uptake and opportunities10.1016/j.mattod.2017.07.001 ↗
12. Revolutionizing manufacturing: A comprehensive overview of additive manufacturing processes, materials, developments, and challenges10.1016/j.jmapro.2023.10.024 ↗
13. Diniță, A., Ripeanu, R.G., Ilincă, C.N., Cursaru, D., Matei, D., Naim, R.I., Tănase, M., and Portoacă, A.I. (2024). Advancements in Fiber-Reinforced Polymer Composites: A Comprehensive Analysis. Polymers, 16.10.3390/polym16010002 ↗
14. Advancements and applications of lightweight structures: A comprehensive review10.1007/s44290-024-00049-z ↗
15. Review of natural fiber-reinforced engineering plastic composites, their applications in the transportation sector and processing techniques10.1177/0892705719889095 ↗
16. 3D/4D Printed Functional Continuous Fiber-reinforced Polymer Composites: Progress and Perspectives
17. 3D printed continuous fiber reinforced composite lightweight structures: A review and outlook10.1016/j.compositesb.2022.110450 ↗
18. 3D Printing of Continuous Fiber Reinforced Polymer Composites: Development, Application, and Prospective
19. A feedback-based print quality improving strategy for FDM 3D printing: An optimal design approach10.1007/s00170-021-08332-4 ↗
20. Non-destructive quality control methods in additive manufacturing: A survey10.1108/RPJ-08-2019-0224 ↗
21. Additive manufacturing process monitoring and control by non-destructive testing techniques: Challenges and in-process monitoring10.1080/17452759.2017.1351201 ↗
22. Klette, R. (2014). Concise Computer Vision, Springer.10.1007/978-1-4471-6320-6 ↗
23. Deep learning applications in manufacturing operations: A review of trends and ways forward10.1108/JEIM-01-2022-0025 ↗
24. A survey of the advancing use and development of machine learning in smart manufacturing10.1016/j.jmsy.2018.02.004 ↗
25. Trakadas, P., Simoens, P., Gkonis, P., Sarakis, L., Angelopoulos, A., Ramallo-González, A.P., Skarmeta, A., Trochoutsos, C., Calvo, D., and Pariente, T. (2020). An artificial intelligence-based collaboration approach in industrial iot manufacturing: Key concepts, architectural extensions and potential applications. Sensors, 20.10.3390/s20195480 ↗
26. A comprehensive review for industrial applicability of artificial neural networks10.1109/TIE.2003.812470 ↗
27. Artificial neural network-based decision support systems in manufacturing processes: A systematic literature review10.1016/j.cie.2022.107964 ↗
28. De Filippis, L.A.C., Serio, L.M., Facchini, F., and Mummolo, G. (2018). ANN modelling to optimize manufacturing process. Advanced Applications for Artificial Neural Networks, InTech.10.5772/intechopen.71237 ↗
29. Liu, H., and Zhang, G. (2024). Enhancing Efficiency and Energy Optimization: Data-Driven Solutions in Process Industrial Manufacturing. EAI Endorsed Trans. Energy Web, 11.10.4108/ew.6098 ↗
30. Threat of adversarial attacks on deep learning in computer vision: A survey10.1109/ACCESS.2018.2807385 ↗
31. Object recognition and detection with deep learning for autonomous driving applications10.1177/0037549717709932 ↗
32. Computer vision and deep learning techniques for pedestrian detection and tracking: A survey10.1016/j.neucom.2018.01.092 ↗
33. Computer vision and machine learning for medical image analysis: Recent advances, challenges, and way forward
34. LeCun, Y. (1989). Generalization and network design strategies. Connections in Perspective, Elsevier.
35. Shaha, M., and Pawar, M. (2018, January 29–31). Transfer learning for image classification. Proceedings of the 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India.10.1109/ICECA.2018.8474802 ↗
36. Conditional weighted ensemble of transferred models for camera based onboard pedestrian detection in railway driver support systems
37. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems 25 (NIPS 2012), Lake Tahoe, NA, USA.
38. Transfer learning using vgg-16 with deep convolutional neural network for classifying images
39. Shafiq, M., and Gu, Z. (2022). Deep residual learning for image recognition: A survey. Appl. Sci., 12.10.3390/app12188972 ↗
40. Generalisable 3D printing error detection and correction via multi-head neural networks10.1038/s41467-022-31985-y ↗
41. Banadaki, Y., Razaviarab, N., Fekrmandi, H., Li, G., Mensah, P., Bai, S., and Sharifi, S. (2021). Automated quality and process control for additive manufacturing using deep convolutional neural networks. Recent Prog. Mater., 4.10.21926/rpm.2201005 ↗
42. Online quality monitoring in material extrusion additive manufacturing processes based on laser scanning technology10.1016/j.precisioneng.2019.06.004 ↗
43. A layerwise monitoring methodology based on blue laser line profilometer for Material Extrusion processes10.1007/s00170-023-11864-6 ↗
44. Reckert, A., Lang, V., Weingarten, S., Johne, R., Klein, J.H., and Ihlenfeldt, S. (2024). Quality Prediction and Classification of Process Parameterization for Multi-Material Jetting by Means of Computer Vision and Machine Learning. J. Manuf. Mater. Process., 8.10.3390/jmmp8010008 ↗
45. Enhancing additive manufacturing precision: Intelligent inspection and optimization for defect-free continuous carbon fiber-reinforced polymer10.1016/j.jcomc.2024.100451 ↗
46. Iftekar, S.F., Aabid, A., Amir, A., and Baig, M. (2023). Advancements and limitations in 3D printing materials and technologies: A critical review. Polymers, 15.10.3390/polym15112519 ↗
47. Potential of Recycled PLA in 3D Printing: A Review
48. Designing of PLA scaffolds for bone tissue replacement fabricated by ordinary commercial 3D printer10.1186/s13036-017-0074-3 ↗
49. Comparison of injection moulded, natural fibre-reinforced composites with PP and PLA as matrices10.1177/0892705711423291 ↗
50. Medical applications of biomaterials: The case of design and manufacture of orthopedic corsets made of polylactic acid by additive manufacturing10.4028/www.scientific.net/MSF.952.223 ↗
51. Gupta, B.B., and Sheng, M. (2019). Machine Learning for Computer and Cyber Security, CRC Press.10.1201/9780429504044 ↗
52. Classification of mechanism of reinforcement in the fiber-matrix interface: Application of Machine Learning on nanoindentation data10.1016/j.matdes.2020.108705 ↗
53. Salehi, A.W., Khan, S., Gupta, G., Alabduallah, B.I., Almjally, A., Alsolai, H., Siddiqui, T., and Mellit, A. (2023). A study of CNN and transfer learning in medical imaging: Advantages, challenges, future scope. Sustainability, 15.10.3390/su15075930 ↗
54. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
55. Li, F.F. (2024, December 23). The ImageNet Project. Available online: https://www.image-net.org/.
56. Smith, L.N. (2018). A disciplined approach to neural network hyper-parameters: Part 1–learning rate, batch size, momentum, and weight decay. arXiv.
57. Al-Mahadeen, B., AlTarawneh, M.S., and AlTarawneh, I.H. (2010). Signature region of interest using auto cropping. arXiv.
58. A GUI for automatic extraction of signature from image document
59. Chen, J., Bai, G., Liang, S., and Li, Z. (2016, January 27–30). Automatic image cropping: A computational complexity study. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.61 ↗
60. Yan, J., Lin, S., Bing Kang, S., and Tang, X. (2013, January 23–28). Learning the change for automatic image cropping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.130 ↗
61. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
62. Data augmentation using random image cropping and patching for deep CNNs10.1109/TCSVT.2019.2935128 ↗
63. Random erasing data augmentation
64. A review: Data pre-processing and data augmentation techniques10.1016/j.gltp.2022.04.020 ↗
65. Style transfer via texture synthesis10.1109/TIP.2017.2678168 ↗
66. Frigo, O., Sabater, N., Delon, J., and Hellier, P. (2016, January 27–30). Split and match: Example-based adaptive patch sampling for unsupervised style transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.66 ↗
67. Bowles, C., Chen, L., Guerrero, R., Bentley, P., Gunn, R., Hammers, A., Dickie, D.A., Hernández, M.V., Wardlaw, J., and Rueckert, D. (2018). Gan augmentation: Augmenting training data using generative adversarial networks. arXiv.
68. Perez, L. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv.
69. Shekhar, S., Bansode, A., and Salim, A. (2021, January 8–10). A comparative study of hyper-parameter optimization tools. Proceedings of the 2021 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), Brisbane, Australia.10.1109/CSDE53843.2021.9718485 ↗
70. Advanced hyperparameter optimization of deep learning models for wind power prediction10.1016/j.renene.2023.119700 ↗