A High-Performance Deep Learning Algorithm for the Automated Optical Inspection of Laser Welding
Source abstract
Abstract
The battery industry has been growing fast because of strong demand from electric vehicle and power storage applications.Laser welding is a key process in battery manufacturing. To control the production quality, the industry has a great desire for defect inspection of automated laser welding. Recently, Convolutional Neural Networks (CNNs) have been applied with great success for detection, recognition, and classification. In this paper, using transfer learning theory and pre-training approach in Visual Geometry Group (VGG) model, we proposed the optimized VGG model to improve the efficiency of defect classification. Our model was applied on an industrial computer with images taken from a battery manufacturing production line and achieved a testing accuracy of 99.87%. The main contributions of this study are as follows: (1) Proved that the optimized VGG model, which was trained on a large image database, can be used for the defect classification of laser welding. (2) Demonstrated that the pre-trained VGG model has small model size, lower fault positive rate, shorter training time, and prediction time; so, it is more suitable for quality inspection in an industrial environment. Additionally, we visualized the convolutional layer and max-pooling layer to make it easy to view and optimize the model.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Welding Techniques and Residual Stresses · Thermography and Photoacoustic Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518000, China
References (32)
Show source-provided references
1. Lee, S.S., Kim, T.H., Hu, S.J., Cai, W.W., and Abell, J.A. (2010, January 12–15). Joining Technologies for Automotive Lithium-Ion Battery Manufacturing: A Review. Proceedings of the ASME 2010, International Manufacturing Science and Engineering Conference, Erie, PA, USA.10.1115/MSEC2010-34168 ↗
2. Characterization of Joint Quality in Ultrasonic Welding of Battery Tabs10.1115/1.4023364 ↗
3. A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision10.1007/s00170-016-9481-8 ↗
4. Progress in NDT of resistance spot welding of aluminium using ultrasonic C-scan10.1016/j.ndteint.2012.02.005 ↗
5. Defect detection in X-ray images using fuzzy reasoning10.1016/S0262-8856(00)00075-5 ↗
6. Jiaxin, S., Han, S., Dong, D., Li, W., and Huayong, C. (2011, January 15–17). Automatic weld defect detection in real-time X-ray images based on support vector machine. Proceedings of the 4th International Congress on Image and Signal Processing (CISP 2011), Shanghai, China.
7. Classification of Solder Joint Using Feature Selection Based on Bayes and Support Vector Machine10.1109/TCPMT.2012.2231902 ↗
8. Implementation of an Automatic Optical Inspection System for Solder Quality Classification of THT Solder Joints10.1109/TCPMT.2018.2864666 ↗
9. Automatic visual solder joint inspection10.1109/JRA.1985.1086997 ↗
10. A New IC Solder Joint Inspection Method for an Automatic Optical Inspection System Based on an Improved Visual Background Extraction Algorithm10.1109/TCPMT.2015.2501284 ↗
11. Color Biological Features-Based Solder Paste Defects Detection and Classification on Printed Circuit Boards10.1109/TCPMT.2012.2205149 ↗
12. IC solder joint inspection based on the Gaussian mixture model10.1108/SSMT-03-2016-0005 ↗
13. SMT defect classification by feature extraction region optimization and machine learning10.1007/s00170-018-3022-6 ↗
14. Support vector machine-based inspection of solder joints using circular illumination10.1049/el:20000342 ↗
15. Hongwei, X., Zhang, X., Yongcong, K., and Gaofei, O. (2011). Solder Joint Inspection Method for Chip Component Using Improved AdaBoost and Decision Tree, IEEE.10.1109/TCPMT.2011.2168531 ↗
16. Defect Classification Method of PCB Solder Joint by Color Features and Region Segmentation10.5302/J.ICROS.2017.17.0187 ↗
17. Deep learning10.1038/nature14539 ↗
18. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with deep Convolutional Neural Networks, Proceedings of the 25th International Conference on Neural Information Processing Systems, Siem Reap, Cambodia, 13–16 December 2018—Volume 1, Curran Associates Inc.
19. Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
20. Goh, J., and Lim, C.T. (2015). Vein Tracking Using 880nm Near Infrared and CMOS Sensor with Maximum Curvature Points Segmentation, Proceedings of the 7th Wacbe World Congress on Bioengineering 2015, Singapore, 6–8 July 2015, Springer.
21. Manufacturing intelligence for reducing false alarm of defect classification by integrating similarity matching approach in CMOS image sensor manufacturing10.1016/j.cie.2016.05.009 ↗
22. Qawaqneh, Z., Abu Mallouh, A., and Barkana, B.D. (2017). Deep Convolutional Neural Network for Age Estimation based on VGG-Face Model. arXiv.
23. Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., and Darrell, T. (2013). DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. arXiv.
24. Integration of image quality and motion cues for face anti-spoofing: A neural network approach10.1016/j.jvcir.2016.03.019 ↗
25. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical Evaluation of Rectified Activations in Convolutional Network. arXiv.
26. Liu, W., Wen, Y., Yu, Z., and Yang, M. (2016). Large-Margin Softmax Loss for Convolutional Neural Networks. arXiv.
27. Wilson, A.C., Roelofs, R., Stern, M., Srebro, N., and Recht, B. (2017). The Marginal Value of Adaptive Gradient Methods in Machine Learning, NIPS.
28. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2013). OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks, Cornell University.
29. He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.10.1109/CVPR.2016.90 ↗
30. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2016). Densely Connected Convolutional Networks, Cornell University.10.1109/CVPR.2017.243 ↗
31. Howard, A., Sandler, M., Chu, G., Chen, L.-C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (2019). Searching for MobileNetV3. arXiv.10.1109/ICCV.2019.00140 ↗
32. Zeiler, M.D., and Fergus, R. (2014). Visualizing and Understanding Convolutional Networks, Springer International Publishing.10.1007/978-3-319-10590-1_53 ↗