journal article·2024-08-21Open access

Soldering Defect Segmentation Method for PCB on Improved UNet

Zhongke Li, Xiaofang Liu

Applied Sciences· Volume 14· Issue 16

Abstract

Despite being indispensable devices in the electronic manufacturing industry, printed circuit boards (PCBs) may develop various soldering defects in the production process, which seriously affect the product’s quality. Due to the substantial background interference in the soldering defect image and the small and irregular shapes of the defects, the accurate segmentation of soldering defects is a challenging task. To address this issue, a method to improve the encoder–decoder network structure of UNet is proposed for PCB soldering defect segmentation. To enhance the feature extraction capabilities of the encoder and focus more on deeper features, VGG16 is employed as the network encoder. Moreover, a hybrid attention module called the DHAM, which combines channel attention and dynamic spatial attention, is proposed to reduce the background interference in images and direct the model’s focus more toward defect areas. Additionally, based on GSConv, the RGSM is introduced and applied in the decoder to enhance the model’s feature fusion capabilities and improve the segmentation accuracy. The experiments demonstrate that the proposed method can effectively improve the segmentation accuracy for PCB soldering defects, achieving an mIoU of 81.74% and mPA of 87.33%, while maintaining a relatively low number of model parameters at only 22.13 M and achieving an FPS of 30.16, thus meeting the real-time detection speed requirements.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Advanced Neural Network Applications · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, Sichuan University of Science & Engineering, Yibin 644000, China

Funding

Academician (Expert) Workstation Fund Project of Sichuan Province of China · Special Fund for Training High Level Innovative Talents of Sichuan University of Science and Engineering · Sichuan University of Science and Engineering for Talent introduction project · Project of Sichuan University of Science and Engineering for Research on the Ideological and Political Construction of Machine Learning Curriculum · Innovation Fund of Postgraduate, Sichuan University of Science & Engineering

References (36)

Show source-provided references
1. Yuan, Z., Tang, X., Ning, H., and Yang, Z. (2024). LW-YOLO: Lightweight Deep Learning Model for Fast and Precise Defect Detection in Printed Circuit Boards. Symmetry, 16.10.3390/sym16040418 ↗
2. A Survey of PCB Defect Detection Algorithms10.1007/s10836-023-06091-6 ↗
3. Review of Vision-Based Defect Detection Research and Its Perspectives for Printed Circuit Board10.1016/j.jmsy.2023.08.019 ↗
4. Printed Circuit Boards Defect Detection Method Based on Improved Fully Convolutional Networks10.1109/ACCESS.2022.3214306 ↗
5. Automatic Printed Circuit Board Inspection: A Comprehensible Survey10.1007/s44163-023-00081-5 ↗
6. A Review of Various Defects in PCB10.1007/s10836-022-06026-7 ↗
7. Chen, I.-C., Hwang, R.-C., and Huang, H.-C. (2023). PCB Defect Detection Based on Deep Learning Algorithm. Processes, 11.10.3390/pr11030775 ↗
8. Xu, Y., and Huo, H. (2024). DSASPP: Depthwise Separable Atrous Spatial Pyramid Pooling for PCB Surface Defect Detection. Electronics, 13.10.3390/electronics13081490 ↗
9. Xiao, G., Hou, S., and Zhou, H. (2024). PCB Defect Detection Algorithm Based on CDI-YOLO. Sci. Rep., 14.10.1038/s41598-024-57491-3 ↗
10. Solder Joint Inspection on Printed Circuit Boards: A Survey and A Dataset10.1109/TIM.2023.3277935 ↗
11. Printed Circuit Board Defect Detection Methods Based on Image Processing, Machine Learning and Deep Learning: A Survey10.1109/ACCESS.2023.3245093 ↗
12. LDD-Net: Lightweight Printed Circuit Board Defect Detection Network Fusing Multi-Scale Features10.1016/j.engappai.2023.107628 ↗
13. Saberironaghi, A., Ren, J., and El-Gindy, M. (2023). Defect Detection Methods for Industrial Products Using Deep Learning Techniques: A Review. Algorithms, 16.10.3390/a16020095 ↗
14. Božič, J., Tabernik, D., and Skočaj, D. (2021, January 10–15). End-to-End Training of A Two-Stage Neural Network for Defect Detection. Proceedings of the 2020 25th International Conference on Pattern Recognition, Milan, Italy.10.1109/ICPR48806.2021.9412092 ↗
15. PCB Defects Target Detection Combining Multi-Scale and Attention Mechanism10.1016/j.engappai.2023.106359 ↗
16. PCB Surface Defect Fast Detection Method Based on Attention and Multi-Source Fusion10.1007/s11042-023-15495-7 ↗
17. TDD-net: A Tiny Defect Detection Network for Printed Circuit Boards10.1049/trit.2019.0019 ↗
18. Single-Shot Detector with Enriched Semantics for PCB Tiny Defect Detection
19. A Lightweight Surface Defect Detection Framework Combined with Dual-Domain Attention Mechanism10.1016/j.eswa.2023.121726 ↗
20. Yu, Y., Wang, C., Fu, Q., Kou, R., Huang, F., Yang, B., Yang, T., and Gao, M. (2023). Techniques and Challenges of Image Segmentation: A Review. Electronics, 12.10.3390/electronics12051199 ↗
21. An Adaptive Feature Reconstruction Network for the Precise Segmentation of Surface Defects on Printed Circuit Boards10.1007/s10845-022-02008-w ↗
22. Deep Siamese Semantic Segmentation Network for PCB Welding Defect Detection10.1109/TIM.2022.3154814 ↗
23. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany. Part III.10.1007/978-3-319-24574-4_28 ↗
24. Chen, H., and Min, B.-W. (2024). Research on Mobile Phone Backplane Defect Segmentation Based on MDAF-UNet. Electronics, 13.10.3390/electronics13071385 ↗
25. A Novel Multi-Scale Cross-Patch Attention with Dilated Convolution (MCPAD-UNET) for Metallic Surface Defect Detection10.1007/s11760-023-02745-2 ↗
26. Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., and Liu, Z. (2020, January 13–19). Dynamic Convolution: Attention over Convolution Kernels. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01104 ↗
27. Li, H., Li, J., Wei, H., Liu, Z., Zhan, Z., and Ren, Q. (2022). Slim-neck by GSConv: A Better Design Paradigm of Detector Architectures for Autonomous Vehicles. arXiv.
28. Li, Y., Hou, Q., Zheng, Z., Cheng, M.-M., Yang, J., and Li, X. (2023, January 2–6). Large Selective Kernel Network for Remote Sensing Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01540 ↗
29. Cai, X., Lai, Q., Wang, Y., Wang, W., Sun, Z., and Yao, Y. (2024). Poly Kernel Inception Network for Remote Sensing Detection. arXiv.10.1109/CVPR52733.2024.02617 ↗
30. Park, J., Woo, S., Lee, J.-Y., and Kweon, I.S. (2018). Bam: Bottleneck Attention Module. arXiv.
31. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
32. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
33. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Eecoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
34. SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
35. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
36. Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, January 15–20). Deep High-Resolution Representation Learning for Human Pose Estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗