Drainage Pipeline Multi-Defect Segmentation Assisted by Multiple Attention for Sonar Images
Source abstract
Abstract
Drainage pipeline construction projects are vulnerable to a range of defects, such as branch concealed joints, variable diameter, two pipe mouth significances, foreign object insertion, pipeline rupture, and pipeline end disconnection, generated during long-term service in a complex environment. This paper proposes two enhancements to multiple attention learning to detect and segment multiple defects. Firstly, we collected numerous samples of drainage pipeline sonar defect videos. Then, our multiple attention segmentation network was used for target segmentation. The test precision and accuracy of MAP@50 reach 96.0% and 90.9%, respectively, in the segmentation prediction. Compared to the coordinate attention and convolutional block attention module attention models, it had a significant precision advantage, and the weight file size is merely 7.0 MB, which is far smaller than the Yolov9 model segmentation weight size. The multiple attention method proposed in this paper was adopted for detection, instance segmentation, and pose detection in different public datasets, especially in the object detection of the coco128-seg dataset under the same condition. Map@50:95 has increased by 13.0% assisted by our multiple attention mechanism. The results indicated the memory efficiency and high precision of the integration of the multiple attention model on several public datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Advanced Neural Network Applications · Domain Adaptation and Few-Shot Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information Science and Engineering, Hohai University, Changzhou 213200, China
Auto Subsea Vehicles Inc., Shanghai 201306, China
Funding
Natural Science foundation of China
References (27)
Show source-provided references
1. A localization algorithm based on pose graph using Forward-looking sonar for deep-sea mining vehicle10.1016/j.oceaneng.2023.114968 ↗
2. Detecting large-scale underwater cracks based on remote operated vehicle and graph convolutional neural network10.1007/s11709-022-0855-8 ↗
3. Nondestructive evaluation of steel-concrete composite structure using high-frequency ultrasonic guided wave10.1016/j.ultras.2020.106096 ↗
4. Wang, J., Shan, T., Chandrasekaran, M., Osedach, T., and Englot, B. (2019, January 20–24). Deep learning for detection and tracking of underwater pipelinelines using multibeam imaging sonar. Proceedings of the IEEE International Conference on Robotics and Automation Workshop, Montreal, Canada.
5. Realistic Sonar Image Simulation Using Deep Learning for Underwater Object Detection10.1007/s12555-019-0691-3 ↗
6. Segmentation of sonar images with intensity inhomogeneity based on improved MRF10.1016/j.apacoust.2019.107051 ↗
7. Underwater sonar image segmentation combining pixel-level and region-level information10.1016/j.compeleceng.2022.107853 ↗
8. Shipwreck Target Recognition in Side-Scan Sonar Images by Improved YOLOv3 Model Based on Transfer Learning10.1109/ACCESS.2020.3024813 ↗
9. Chen, L., and Zheng, M. (2021). Underwater Target Recognition Based on Improved YOLOv4 Neural Network. Electronics, 10.10.3390/electronics10141634 ↗
10. Yu, Y., Zhao, J., Gong, Q., Huang, C., Zheng, G., and Ma, J. (2021). Real-Time Underwater Maritime Object Detection in Side-Scan Sonar Images Based on Transformer-YOLOv5. Remote Sens., 13.10.3390/rs13183555 ↗
11. Underwater scallop recognition algorithm using improved YOLOv510.1016/j.aquaeng.2022.102273 ↗
12. Chen, R., Zhan, S., and Chen, Y. (2022, January 17–20). Underwater Pipeline Target Detection Algorithm Based on YOLO and Swin Transformer for Sonar Images. Proceedings of the OCEANS Conference 2022 Hampton Roads, Hampton Roads, VA, USA.10.1109/OCEANS47191.2022.9976986 ↗
13. Side scan Drainage pipeline image target detection method based on improved YOLOv5 network
14. U-YOLOv7: A network for underwater organism detection10.1016/j.ecoinf.2023.102108 ↗
15. Fuchs, L.R., Noren, A., and Johansson, P. (2022, January 21–24). GAN-enhanced simulated sonar images for deep learning based detection and classification. Proceedings of the Oceans 2022–Chennai Conference, Chennai, India.10.1109/OCEANSChennai45887.2022.9775246 ↗
16. Side scan sonar image augmentation for sediment classification using deep learning based transfer learning approach10.1016/j.matpr.2021.07.222 ↗
17. Optical image-to-underwater small target synthetic aperture sonar image translation algorithm based on improved CycleGAN
18. Boosting fish counting in sonar images with global attention and point supervision10.1016/j.engappai.2023.107093 ↗
19. Sonar image garbage detection via global despeckling and dynamic attention graph optimization10.1016/j.neucom.2023.01.081 ↗
20. Zhao, D., Ge, W., Chen, P., Hu, Y., Dang, Y., Liang, R., and Guo, X. (2022). Feature pyramid u-net with attention for semantic segmentation of forward-looking sonar images. Sensors, 22.10.3390/s22218468 ↗
21. Huang, H., Zuo, Z., Sun, B., Wu, P., and Zhang, J. (2022). DSA-SOLO: Double split attention solo for side-scan sonar target segmentation. Appl. Sci., 12.10.3390/app12189365 ↗
22. Zhang, X., Liu, C., Yang, D., Song, T., Ye, Y., Li, K., and Song, Y. (2023). RFAConv: Innovating spatial attention and standard convolutional operation. arXiv.
23. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
24. Woo, S., Park, J., Lee, J., and Kweon, I. (2018). CBAM: Convolutional Block Attention Module. Computer Vision–ECCV 2018: 15th European Conference, Munich, Germany, September 8–14, 2018, Proceedings, Part VII, Springer.10.1007/978-3-030-01234-2_1 ↗
25. Squeeze-and-Excitation Networks10.1109/TPAMI.2019.2913372 ↗
26. Ouyang, D., He, S., Zhang, G., Luo, M., Guo, H., Zhan, J., and Huang, Z. (2023, January 4–10). Efficient Multi-Scale Attention Module with Cross-Spatial Learning. Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096516 ↗
27. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗