DEU-Net: A Multi-Scale Fusion Staged Network for Magnetic Tile Defect Detection
Source abstract
Abstract
Surface defect detection is a critical task in the manufacturing industry to ensure product quality and machining efficiency. Image-based precise defect detection faces significant challenges due to defects lacking fixed shapes and the detection being heavily influenced by lighting conditions. Addressing the efficiency demands of defect detection algorithms, often deployed on embedded devices, and the highly imbalanced pixel ratio between foreground and background images, this paper introduces a multi-scale fusion staged U-shaped convolutional neural network (DEU-Net). The network provides segmentation results for defect anomalies while indicating the probability of defect presence. It enables the model to train with fewer parameters, a crucial requirement for practical applications. The proposed model achieves an MIoU of 66.94 and an F1 score of 74.89 with lower Params (36.675) and Flops (19.714). Comparative analysis with FCN, U-Net, Deeplab v3+, U-Net++, Attention U-Net, and Trans U-Net demonstrates the superiority of the proposed approach in surface defect detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Infrastructure Maintenance and Monitoring · Surface Roughness and Optical Measurements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
Funding
National Key R&D Program of China
References (34)
Show source-provided references
1. Chen, Y., Ding, Y., Zhao, F., Zhang, E., Wu, Z., and Shao, L. (2021). Surface defect detection methods for industrial products: A review. Appl. Sci., 11.10.3390/app11167657 ↗
2. Qi, S., Yang, J., and Zhong, Z. (2020, January 26–28). A review on industrial surface defect detection based on deep learning technology. Proceedings of the International Conference on Machine Learning and Machine Intelligence (MLMI), Online.10.1145/3426826.3426832 ↗
3. Backpropagation applied to handwritten zip code recognition
4. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
5. Faster r-cnn: Towards real-time object detection with region proposal networks
6. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
7. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
8. Ronneberger, O., and Fischer PBrox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18, 2015.
9. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation10.1109/TMI.2019.2959609 ↗
10. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M.J., Heinrich, M.P., Misawa, K., Mori, K., McDonagh, S.G., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv.
11. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
12. Task decomposition and synchronization for semantic biomedical image segmentation10.1109/TIP.2020.3003735 ↗
13. An efficient semantic segmentation method based on transfer learning from object detection10.1049/ipr2.12005 ↗
14. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
15. Deep industrial image anomaly detection: A survey10.1007/s11633-023-1459-z ↗
16. Chen, Z., Deng, J., Zhu, Q., Wang, H., and Chen, Y. (2022). A systematic review of machine-vision-based leather surface defect inspection. Electronics, 11.10.3390/electronics11152383 ↗
17. Wood knot defects recognition with gray-scale histogram features
18. Design of automation system for ceramic surface quality control using fuzzy logic method at Balai Besar Keramik10.1051/matecconf/201713500053 ↗
19. Deep Learning Algorithms and Their Relevance: A Review
20. Badrinarayanan, V., Kendall, A., and SegNet, R.C. (2015). A deep convolutional encoder-decoder architecture for image segmentation. arXiv.
21. Feature pyramid and hierarchical boosting network for pavement crack detection10.1109/TITS.2019.2910595 ↗
22. Xiao, X., Lian, S., Luo, Z., and Li, S. (2018, January 19–21). Weighted res-unet for high-quality retina vessel segmentation. Proceedings of the 2018 9th International Conference on Information Technology in Medicine and Education (ITME), Hangzhou, China.10.1109/ITME.2018.00080 ↗
23. Crimi, A., Bakas, S., Kuijf, H., Keyvan, F., Reyes, M., and van Walsum, T. (2019). Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries. BrainLes 2018, Springer. Lecture Notes in Computer Science.10.1007/978-3-030-11723-8 ↗
24. Detection of Covid-19 from X-ray Images using Deep Learning Techniques
25. Densely connected deep neural network considering connectivity of pixels for automatic crack detection10.1016/j.autcon.2019.103018 ↗
26. Pixel-level cracking detection on 3D asphalt pavement images through deep-learning-based CrackNet-V10.1109/TITS.2019.2891167 ↗
27. Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network10.1111/mice.12297 ↗
28. Yang, C., Guo, X., Wang, T., Yang, Y., Ji, N., Li, D., Lv, H., and Ma, T. (2019, January 23–27). Automatic brain tumor segmentation method based on modified convolutional neural network. Proceedings of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Berlin, Germany.10.1109/EMBC.2019.8857303 ↗
29. Machining surface roughness detection by adaptive deep fusion capsule network with low illumination and noise robustness10.1088/1361-6501/ad060f ↗
30. Delving deep into spatial pooling for squeeze-and-excitation networks10.1016/j.patcog.2021.108159 ↗
31. Xie, S., and Tu, Z. (2015, January 7–13). Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.164 ↗
32. U2-Net: Going deeper with nested U-structure for salient object detection10.1016/j.patcog.2020.107404 ↗
33. Segmentation-based deep-learning approach for surface-defect detection10.1007/s10845-019-01476-x ↗
34. Surface defect saliency of magnetic tile10.1007/s00371-018-1588-5 ↗