Bridge Crack Segmentation Method Based on Parallel Attention Mechanism and Multi-Scale Features Fusion
Source abstract
Abstract
Regular inspection of bridge cracks is crucial to bridge maintenance and repair. The traditional manual crack detection methods are time-consuming, dangerous and subjective. At the same time, for the existing mainstream vision-based automatic crack detection algorithms, it is challenging to detect fine cracks and balance the detection accuracy and speed. Therefore, this paper proposes a new bridge crack segmentation method based on parallel attention mechanism and multi-scale features fusion on top of the DeeplabV3+ network framework. First, the improved lightweight MobileNet-v2 network and dilated separable convolution are integrated into the original DeeplabV3+ network to improve the original backbone network Xception and atrous spatial pyramid pooling (ASPP) module, respectively, dramatically reducing the number of parameters in the network and accelerates the training and prediction speed of the model. Moreover, we introduce the parallel attention mechanism into the encoding and decoding stages. The attention to the crack regions can be enhanced from the aspects of both channel and spatial parts and significantly suppress the interference of various noises. Finally, we further improve the detection performance of the model for fine cracks by introducing a multi-scale features fusion module. Our research results are validated on the self-made dataset. The experiments show that our method is more accurate than other methods. Its intersection of union (IoU) and F1-score (F1) are increased to 77.96% and 87.57%, respectively. In addition, the number of parameters is only 4.10 M, which is much smaller than the original network; also, the frames per second (FPS) is increased to 15 frames/s. The results prove that the proposed method fits well the requirements of rapid and accurate detection of bridge cracks and is superior to other methods.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Structural Integrity and Reliability Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (39)
Show source-provided references
1. Status and prospect of technical development for bridges in China10.1360/N972015-00912 ↗
2. H. Y. Xu, “Research on bridge crack detection method based on convolutional neural network,” M.S. Theses, Tianjin University, China, 2019.
3. Evaluating pavement cracks with bidimensional empirical mode decomposition10.1155/2008/861701 ↗
4. Learning-based road crack detection using gradient boost decision tree
5. Deep residual learning for image recognition
6. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
7. Fully convolutional networks for semantic segmentation
8. U-Net: Convolutional networks for biomedical image segmentation
9. Crack segmentation by leveraging multiple frames of varying illumination
10. SegNet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
11. UNet-based model for crack detection integrating visual explanations10.1016/j.conbuildmat.2021.126265 ↗
12. Application of improved Canny operator in crack detection
13. Pavement crack detection using Otsu thresholding for image segmentation
14. A potential crack region method to detect crack using image processing of multiple thresholding10.1007/s11760-021-02123-w ↗
15. Bridge crack detection algorithm based on Bilateral-Frangi filter
16. Bridge crack detection algorithm based on Bilateral-Frangi filter
17. Recognition and evaluation of bridge cracks with modified active contour model and greedy search-based support vector machine10.1016/j.autcon.2017.01.019 ↗
18. A texture-based video processing methodology using Bayesian data fusion for autonomous crack detection on metallic surfaces10.1111/mice.12256 ↗
19. Local binary patterns and its application to facial image analysis: A survey10.1109/TSMCC.2011.2118750 ↗
20. A comprehensive survey on support vector machine classification: Applications, challenges and trends10.1016/j.neucom.2019.10.118 ↗
21. A triple-thresholds pavement crack detection method leveraging random structured forest10.1016/j.conbuildmat.2020.120080 ↗
22. Automatic bridge crack detection using a convolutional neural network10.3390/app9142867 ↗
23. Bridge crack detection based on SSENets10.3390/app10124230 ↗
24. Structural crack detection and recognition based on deep learning10.3390/app11062868 ↗
25. Automated pavement crack damage detection using deep multiscale convolutional features10.1155/2020/6412562 ↗
26. A real-time bridge crack detection method based on an improved inception-resnet-v2 structure10.1109/ACCESS.2021.3093210 ↗
27. Real-time tunnel crack analysis system via deep learning10.1109/ACCESS.2019.2916330 ↗
28. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
29. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
30. Computer vision-based concrete crack detection using U-net fully convolutional networks10.1016/j.autcon.2019.04.005 ↗
31. Pixel-level bridge crack detection using a deep fusion about recurrent residual convolution and context encoder network10.1016/j.measurement.2021.109171 ↗
32. Pavement crack detection network based on pyramid structure and attention mechanism10.1049/iet-ipr.2019.0973 ↗
33. Automatic pavement crack detection and classification using multiscale feature attention network10.1109/ACCESS.2019.2956191 ↗
34. Attention-based convolutional neural network for pavement crack detection10.1155/2021/5520515 ↗
35. Xception: Deep learning with depthwise separable convolutions
36. AF-Net: A medical image segmentation network based on attention mechanism and feature fusion10.32604/cmc.2021.017481 ↗
37. Focal loss for dense object detection
38. Dice loss for data-imbalanced NLP tasks
39. Research on detection algorithm for bridge cracks based on deep learning