MDRNet: efficient surface defect segmentation network based on CNN and Transformer
Source abstract
Abstract
In industrial production, accurate segmentation of surface defects is crucial for ensuring product quality. However, the variability in defect size and shape, along with low contrast and inter-category similarity, limits the effectiveness of existing segmentation models in complex environments. These models often struggle with scale and shape variations, experience significant performance decline under lighting changes or low-contrast conditions, and lack sufficient category discrimination. Thus, precise surface defect segmentation remains a significant challenge. To address this, we propose MDRNet, an efficient surface defect segmentation network that integrates the advantages of CNNs and Transformers. First, we integrate multi-scale channel attention (MSCA) with the Transformer to design an efficient MSCA-Transformer module for feature extraction. This module focuses on local information while effectively establishing long-range dependencies, ensuring accurate multi-scale defect representation under low contrast. Second, we adopt Dense Connected Shuffle Group Convolution to efficiently integrate critical information from deep and shallow layers. Finally, we introduce a novel Region Attention module that highlights important local features while suppressing redundancy, thereby enhancing the ability to capture inter-category differences. MDRNet achieves the best segmentation performance on four public industrial surface defect datasets. Even in challenging scenarios with low contrast and large defect scale variations, MDRNet robustly delivers precise predictions of defect locations, categories, and contours, fully demonstrating its efficacy.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection · Surface Roughness and Optical Measurements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
China University of Petroleum (East China)
Ultra-Precision Manufacturing Collaborative Innovation Center
Funding
Key Research and Development Program of Shandong Province
References (76)
Show source-provided references
1. 10.1111/mice.1271010.1111/mice.12710 ↗
2. 10.1088/1361-6501/adbf3c10.1088/1361-6501/adbf3c ↗
3. 10.1080/10589759.2025.250055110.1080/10589759.2025.2500551 ↗
4. 10.3390/s2304220410.3390/s23042204 ↗
5. 10.3390/s2512363510.3390/s25123635 ↗
6. 10.1080/10589759.2024.233706110.1080/10589759.2024.2337061 ↗
7. 10.1080/10589759.2025.245757110.1080/10589759.2025.2457571 ↗
8. 10.1007/s10921-024-01149-710.1007/s10921-024-01149-7 ↗
9. 10.1109/CVPR.2015.729896510.1109/CVPR.2015.7298965 ↗
10. 10.1109/TPAMI.2016.264461510.1109/TPAMI.2016.2644615 ↗
11. Chen L-C. Rethinking atrous convolution for semantic image segmentation. arXiv Preprint arXiv: 170605587. 2017.
12. 10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
13. 10.1109/TII.2019.295882610.1109/TII.2019.2958826 ↗
14. 10.1109/TIM.2020.300227710.1109/TIM.2020.3002277 ↗
15. 10.1016/j.knosys.2022.10833810.1016/j.knosys.2022.108338 ↗
16. Yin Z, Qin L, Han G, et al. Ddsnet: deep dual-branch networks for surface defect segmentation. In: Ferrero R, editor. IEEE Transactions on Instrumentation and Measurement. 2024.
17. Song K Feng H Cao T et al. Mfanet: multifeature aggregation network for cross-granularity few-shot seamless steel tubes surface defect segmentation. IEEE transactions on industrial informatics. 2024.10.1109/TII.2024.3383513 ↗
18. 10.1109/TIM.2020.304719010.1109/TIM.2020.3047190 ↗
19. 10.1109/ACCESS.2019.295742710.1109/ACCESS.2019.2957427 ↗
20. 10.1080/10589759.2023.229142910.1080/10589759.2023.2291429 ↗
21. 10.1016/j.eswa.2021.11571810.1016/j.eswa.2021.115718 ↗
22. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Adv Neural Inf Process Syst, 2017; 30.
23. Dosovitskiy A. An image is worth 16x16 words: transformers for image recognition at scale. arXiv Preprint arXiv: 201011929. 2020.
24. 10.1007/978-3-319-10602-1_4810.1007/978-3-319-10602-1_48 ↗
25. 10.1109/CVPR42600.2020.0091510.1109/CVPR42600.2020.00915 ↗
26. Xie E, Wang W, Yu Z, et al. Segformer: simple and efficient design for semantic segmentation with transformers. Adv Neural Inf Process Syst. 2021;34:12077–12090.
27. 10.1109/CVPR52688.2022.0117710.1109/CVPR52688.2022.01177 ↗
28. 10.1016/j.measurement.2024.11439810.1016/j.measurement.2024.114398 ↗
29. Huang X, Li Y, Bao Y, et al. Adaptive cross transformer with contrastive learning for surface defect detection. In: Ferrero R, editor. IEEE Transactions on Instrumentation and Measurement. 2024.
30. Gu A, Dao T. Mamba: linear-time sequence modeling with selective state spaces. arXiv Preprint arXiv: 231200752. 2023.
31. Liu Y, Tian Y, Zhao Y, et al. Vmamba: visual state space model. Adv Neural Inf Process Syst. 2024;37:103031–103063.
32. Lianghui Z, Bencheng L, Qian Z, et al. Vision mamba: efficient visual representation learning with bidirectional state space model. arXivOrg. 2024.
33. Ma J, Li F, Wang B. U-mamba: enhancing long-range dependency for biomedical image segmentation. arXiv Preprint arXiv: 240104722. 2024.
34. Wang Z, Zheng J-Q, Zhang Y, et al. Mamba-Unet: unet-like pure visual Mamba for medical image segmentation. arXiv Preprint arXiv: 240205079. 2024.
35. Cao S, Shen S, Fan S, et al. A novel detection method for valve damage of nuclear power using attention-based U-Net (ABUNet). In: Celik z, editor. IEEE Sensors Journal; 2023.
36. 10.1080/10589759.2024.230532910.1080/10589759.2024.2305329 ↗
37. Zuo H, Zheng Y, Huang Q, et al. Sks-net: skeleton-strengthening network for surface defect segmentation. Measurement Science Technology. 2025; 36(1): 016045.10.1088/1361-6501/ada0d0 ↗
38. Everingham M, Van Gool L, Williams CK, et al. The Pascal Visual Object Classes (VOC) challenge. Int J Comput Vis. 2010;88:303–338.10.1007/s11263-009-0275-4 ↗
39. 10.1109/CVPR.2017.66010.1109/CVPR.2017.660 ↗
40. 10.1007/978-3-030-01261-8_2010.1007/978-3-030-01261-8_20 ↗
41. 10.1109/TIP.2018.287896610.1109/TIP.2018.2878966 ↗
42. Liu T, He Z, Lin Z, et al. An adaptive image segmentation network for surface defect detection. In: Song Y, editor. IEEE Transactions on Neural Networks and Learning Systems; 2022.
43. 10.1109/TIM.2023.328405010.1109/TIM.2023.3284050 ↗
44. 10.1016/j.jii.2022.10040310.1016/j.jii.2022.100403 ↗
45. 10.1109/CVPR46437.2021.0068110.1109/CVPR46437.2021.00681 ↗
46. Zhang Q, Yang Y-B. Rest: an efficient transformer for visual recognition. Adv Neural Inf Process Syst. 2021;34:15475–15485.
47. Wu H, Xiao B, Codella N, et al. Cvt: introducing convolutions to vision transformers. In: Clark J, Matsushita Y, Taylor CJ, Berg T. Proceedings of the IEEE/CVF International Conference on Computer Vision; Virtual Conference (originally scheduled for Montreal, Quebec, Canada). Piscataway (NJ): IEEE; 2021. p. 22–31.
48. Wang W, Yao L, Chen L, et al. Crossformer: a versatile vision transformer hinging on cross-scale attention. arXiv Preprint arXiv: 210800154. 2021.
49. 10.1109/ICCV48922.2021.0071710.1109/ICCV48922.2021.00717 ↗
50. 10.1109/ICCV48922.2021.0098610.1109/ICCV48922.2021.00986 ↗
51. 10.1109/CVPR46437.2021.0162510.1109/CVPR46437.2021.01625 ↗
52. Dai Z, Liu H, Le QV, et al. Coatnet: marrying convolution and attention for all data sizes. Adv Neural Inf Process Syst. 2021;34:3965–3977.
53. Cao H, Wang Y, Chen J, et al. Swin-UNet: uNet-like pure transformer for medical image segmentation. In: Cucchiara R, Matas J, Shashua A, Zelnik-Manor L, edtors. European Conference on Computer Vision; Tel Aviv, Israel. Cham: Springer; 2022. p. 205–218.
54. Kong B, Meng Q, Hao F, et al. Efficient CNN-transformer aggregation network for remote sensing image change detection. In: Al-Haddad SAR, editor. 2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC); Sarawak, Malaysia. Piscataway (NJ): IEEE; 2024. p. 4328–4333.10.1109/SMC54092.2024.10831667 ↗
55. 10.1002/ima.2298710.1002/ima.22987 ↗
56. 10.1016/j.autcon.2022.10431610.1016/j.autcon.2022.104316 ↗
57. 10.1109/TIM.2023.327172310.1109/TIM.2023.3271723 ↗
58. Wang R Cheung CF Liu C et al. Self-supervised siamese transformer for surface defect segmentation in diamond-wire-sawn mono-crystalline silicon wafers. IEEE Transactions on Instrumentation and Measurement. 2025.10.1109/TIM.2025.3527594 ↗
59. 10.3390/electronics1312225710.3390/electronics13122257 ↗
60. Chen Z, Shamsabadi EA, Jiang S, et al. Vision mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces. arXiv Preprint arXiv: 240616518. 2024.
61. Lei Ba J, Kiros JR, Hinton GE. Layer normalization. ArXiv E-Prints. 2016:1607.
62. Iandola F. Densenet: implementing efficient convnet descriptor pyramids. arXivpreprintarxiv: 14041869. 2014.
63. 10.1109/CVPR.2018.0029110.1109/CVPR.2018.00291 ↗
64. 10.1109/CVPR.2018.0071610.1109/CVPR.2018.00716 ↗
65. 10.1007/s11227-025-07456-810.1007/s11227-025-07456-8 ↗
66. 10.1007/978-3-030-01264-9_810.1007/978-3-030-01264-9_8 ↗
67. Shen D, Ji Y, Li P, et al. Ranet: region Attention Network for Semantic Segmentation. Adv Neural Inf Process Syst. 2020;33:13927–13938.
68. 10.1109/TKDE.2021.313660610.1109/TKDE.2021.3136606 ↗
69. 10.1016/j.compind.2021.10345910.1016/j.compind.2021.103459 ↗
70. 10.1109/TIM.2021.312598710.1109/TIM.2021.3125987 ↗
71. 10.1007/s00371-018-1588-510.1007/s00371-018-1588-5 ↗
72. 10.1007/s10845-022-02051-710.1007/s10845-022-02051-7 ↗
73. 10.1016/j.patrec.2024.11.02510.1016/j.patrec.2024.11.025 ↗
74. 10.1371/journal.pone.030288010.1371/journal.pone.0302880 ↗
75. 10.1109/CVPR.2016.9010.1109/CVPR.2016.90 ↗
76. 10.1109/ICCV.2017.7410.1109/ICCV.2017.74 ↗