journal article·2024-01-12Open access

DFP-Net: A Crack Segmentation Method Based on a Feature Pyramid Network

Linjing Li, Ran Liu, Rashid Ali, Bo Chen, Haitao Lin, Yonglong Li, Hua Zhang

Applied Sciences· Volume 14· Issue 2

Abstract

Timely detection of defects is essential for ensuring safe and stable operation of concrete buildings. Automatic segmentation of concrete buildings’ surfaces is challenging due to the high diversity of crack appearance, the detailed information, and the unbalanced proportion of crack pixels and background pixels. In this work, the Double Feature Pyramid Network is designed for high-precision crack segmentation. Our work reached the state-of-the-art level in crack segmentation, with key contributions outlined as follows: firstly, considering the diversity of crack shapes, the network constructs a feature pyramid containing three feature extraction backbones to extract the global feature map with three scale input images. In particular, due to the biggest challenge being too much single-pixel crack area, the targeted feature pyramid based on the high-resolution is added to extract adequate shallow semantic information. Lastly, designing a cascade feature fusion unit to aggregate the extracted multi-dimensional feature maps and obtain the final prediction. Compared with existing crack detection methods, the superior performance of this method has been verified based on extensive experiments, with Pixel Accuracy of 65.99%, Intersection over Union of 44.71%, and Recall of 62.95%, providing a reliable and efficient solution for the health monitoring and maintenance of concrete structures. This work contributes to the advancement of research and practical applications in related fields, offering robust support for the monitoring and maintenance of concrete structures.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Asphalt Pavement Performance Evaluation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China

Engineering Product Development, Singapore University of Technology and Design, Singapore 487372, Singapore

Department of Computer Science, University of Turbat, Turbat 92600, Pakistan

Department of Electronic Engineering, Tsinghua University, Beijing 100084, China

Tianfu Institute of Research and Innovation, Southwest University of Science and Technology, Chengdu 610299, China

Funding

Key Research and Development Program of Heilongjiang · National Key Research and Development Program of China

References (58)

Show source-provided references
1. Research on the coordinated development of greenization and urbanization based on system dynamics and data envelopment analysis—A case study of Tianjin10.1016/j.jclepro.2018.12.046 ↗
2. Greenization of venture capital and green innovation of Chinese entity industry10.1016/j.ecolind.2014.10.025 ↗
3. Dynamic correlation between industry greenization development and ecological balance in China10.3390/su12208329 ↗
4. Forces of hydration that can cause havoc in concrete
5. Golewski, G.L. (2023). The phenomenon of cracking in cement concretes and reinforced concrete structures: The mechanism of cracks formation, causes of their initiation, types and places of occurrence, and methods of detection—A review. Buildings, 13.10.3390/buildings13030765 ↗
6. Zandi, K. (2008). Load-Carrying Capacity of Damaged Concrete Structures. [Ph.D. Thesis, Chalmers University of Technology].
7. Probabilistic service life assessment and maintenance planning of concrete structures10.1061/(ASCE)0733-9445(2006)132:5(810) ↗
8. Calculation of moisture distribution in early-age concrete10.1061/(ASCE)0733-9399(2009)135:8(871) ↗
9. Analysis and Control of Cracks in Concrete Buildings
10. A comparative review of image processing based crack detection techniques on civil engineering structures
11. Fujita, Y., Mitani, Y., and Hamamoto, Y. (2006, January 20–24). A method for crack detection on a concrete structure. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.10.1109/ICPR.2006.98 ↗
12. ICD: A methodology for real time onset detection of overlappedacoustic emission waves10.1016/j.autcon.2020.103341 ↗
13. Machine learning based crack mode classification fromunlabeled acoustic emission waveform features10.1016/j.cemconres.2019.03.001 ↗
14. Autogenous healing of engineered cementitiouscomposites under wet-dry cycles10.1016/j.cemconres.2009.01.013 ↗
15. Fast Tomography: A greedy, heuristic, mesh size–independentmethodology for local velocity reconstruction for AE waves in distance decaying environmentin semi real-time10.1177/14759217211036881 ↗
16. Smart Self-Healing and Self-Sensing Cementitious Composites—Recent Developments, Challenges and Prospects10.1520/ACEM20190023 ↗
17. A new power-based method to determine the first arrival information of an acoustic emission wave10.1177/1475921718815058 ↗
18. Electrical impedance tomographic methods for sensing strain fields andcrack damage in cementitious structures10.1177/1045389X08096052 ↗
19. Influence of micro-cracking on the compositeresistivity of Engineered Cementitious Composites10.1016/j.cemconres.2014.01.002 ↗
20. Comparative testing ofcrack formation in strain-hardening cement-based composites (SHCC)10.1617/s11527-015-0567-9 ↗
21. Application of deep convolutional neural networks for automated and rapid identification and computation of crack statistics of thin cracks in strain hardening cementitious composites (SHCCs)10.1016/j.cemconcomp.2021.104159 ↗
22. Das, A.K., and Leung, C.K.Y. (2022). International Conference on Strain-Hardening Cement-Based Composites, Springer.
23. Automated crack detection on concrete bridges10.1109/TASE.2014.2354314 ↗
24. A method for identifying and measuring early cracks in concrete buildings
25. Crack detection from a concrete surface image based on semantic segmentation using deep learning10.3151/jact.18.493 ↗
26. Deep convolutional neural networks for semantic segmentation of cracks10.1002/stc.2850 ↗
27. Deep cascaded neural networks for automatic detection of structural damage and cracks from images10.5194/isprs-annals-V-2-2020-411-2020 ↗
28. Research on Intelligent Detection Method for Surface Crack Damage of Overflow Dams in Hydroelectric Power Stations
29. Robust automated concrete damage detection algorithms for field applications10.1061/(ASCE)CP.1943-5487.0000257 ↗
30. Elastic moduli of acracked solid10.1016/0020-7683(76)90044-5 ↗
31. Stiffness reduction of cracked solids10.1016/0013-7944(87)90129-9 ↗
32. Hu, D., Tian, T., Yang, H., Xu, S., and Wang, X. (2012, January 15–17). Wall crack detection based on image processing. Proceedings of the 2012 Third International Conference on Intelligent Control and Information Processing, Dalian, China.10.1109/ICICIP.2012.6391474 ↗
33. Zhou, J. (2020). Research on Crack Detection Technology Based on Convolution Neural Network. [Master’s Thesis, Xi’an University of Technology].
34. A Computational Approach To Edge Detection10.1109/TPAMI.1986.4767851 ↗
35. Gao, W., Zhang, X., Yang, L., and Liu, H. (2010, January 9–11). An improved Sobel edge detection. Proceedings of the 2010 3rd International Conference on Computer Science and Information Technology, Chengdu, China.
36. Improved edge detection algorithm for canny operator
37. Research on image text recognition based on canny edge detection algorithm and k-means algorithm10.1007/s13198-021-01262-0 ↗
38. Neural network based CT-Canny edge detector considering watermarking framework10.1007/s12530-021-09369-2 ↗
39. Quantify pixel-level detection of dam surface crack using deep learning10.1088/1361-6501/ac4b8d ↗
40. DcsNet: A real-time deep network for crack segmentation10.1007/s11760-021-02034-w ↗
41. Research on crack segmentation method of hydro-junction project based on target detection network10.1007/s12205-020-1896-y ↗
42. Liu, X. (2014). Detection of Bottom Surface Cracks in Concrete Bridges Based on Digital Image Processing. [Masters’s Thesis, Wuhan University of Technology].
43. Image-based retrieval of concrete crack properties for bridge inspection10.1016/j.autcon.2013.06.011 ↗
44. Oliveira, H., and Correia, P.L. (2014, January 27–30). CrackIT—An image processing toolbox for crack detection and characterization. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025160 ↗
45. Image-based crack detection using crack width transform (CWT) algorithm10.1109/ACCESS.2018.2875889 ↗
46. Shao, C., Chen, Y., Xu, F., and Wang, S. (2019, January 20–22). A kind of pavement crack detection method based on digital image processing. Proceedings of the 2019 IEEE 4th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chengdu, China.10.1109/IAEAC47372.2019.8997810 ↗
47. Automated crack detection and measurement based on digital image correlation10.1016/j.conbuildmat.2020.119383 ↗
48. Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25–28). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
49. Mandal, V., Uong, L., and Adu-Gyamfi, Y. (2018, January 10–13). Automated road crack detection using deep convolutional neural networks. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.10.1109/BigData.2018.8622327 ↗
50. On bridge surface crack detection based on an improved YOLO v3 algorithm10.1016/j.ifacol.2020.12.1994 ↗
51. Road crack detection using deep neural network with receptive field block10.1088/1757-899X/782/4/042033 ↗
52. Automated asphalt highway pavement crack detection based on deformable single shot multi-box detector under a complex environment10.1109/ACCESS.2021.3125703 ↗
53. Li, L., Zhang, H., Pang, J., and Huang, J. (2019, January 20–22). Dam surface crack detection based on deep learning. Proceedings of the 2019 International Conference on Robotics, Intelligent Control and Artificial Intelligence, Shanghai, China.10.1145/3366194.3366327 ↗
54. König, J., Jenkins, M.D., Barrie, P., Mannion, M., and Morison, G. (2019, January 22–25). A convolutional neural network for pavement surface crack segmentation using residual connections and attention gating. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.10.1109/ICIP.2019.8803060 ↗
55. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
56. Semi-supervised semantic segmentation network for surface crack detection10.1016/j.autcon.2021.103786 ↗
57. Fu, H., Meng, D., Li, W., and Wang, Y. (2021). Bridge crack semantic segmentation based on improved Deeplabv3+. J. Mar. Sci. Eng., 9.10.3390/jmse9060671 ↗
58. Crack detection algorithm for concrete structures based on super-resolution reconstruction and segmentation network10.1016/j.autcon.2022.104346 ↗