WDS-YOLO: A Marine Benthos Detection Model Fusing Wavelet Convolution and Deformable Attention
Source abstract
Abstract
Accurate marine benthos detection is a technical prerequisite for underwater robots to achieve automated fishing. Considering the challenges of poor underwater imaging conditions during the actual fishing process, where small objects are easily occluded or missed, we propose WDS-YOLO, an advanced model designed for marine benthos detection, built upon the YOLOv8n architecture. Firstly, the convolutional module incorporated with wavelet transform was used to enhance the backbone network, thereby expanding the receptive field of the model and enhancing its feature extraction ability for marine benthos objects under low visibility conditions. Secondly, we designed the DASPPF module by integrating deformable attention, which dynamically adjusts the attention domain to enhance feature relevance to targets, reducing irrelevant information interference and better adapting to marine benthos shape variations. Finally, the SF-PAFPN feature fusion structure was designed to enhance the model’s ability to detect smaller object features while mitigating false positives and missed detections. The experimental results demonstrated that the proposed method achieved 85.6% mAP@50 on the URPC dataset, representing a 2.1 percentage point improvement over the YOLOv8n model. Furthermore, it outperformed several mainstream underwater object detection algorithms, achieving a detection speed of 104.5 fps. These results offer significant technical guidance for advancing intelligent fishing systems powered by underwater robotic technologies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote-Sensing Image Classification · Spectroscopy and Chemometric Analyses · Underwater Acoustics Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Key Laboratory of Fisheries Information, Ministry of Agriculture and Rural Affairs, College of Information Technology, Shanghai Ocean University, Hucheng Ring Road 999, Shanghai 201306, China
Funding
Research and Development Planning in Key Areas of Guangdong Province
References (57)
Show source-provided references
1. U-YOLOv7: A network for underwater organism detection10.1016/j.ecoinf.2023.102108 ↗
2. Boosting R-CNN: Reweighting R-CNN samples by RPN’s error for underwater object detection10.1016/j.neucom.2023.01.088 ↗
3. A review on underwater autonomous environmental perception and target grasp, the challenge of robotic organism capture10.1016/j.oceaneng.2019.106644 ↗
4. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
5. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
6. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
7. Cai, Z.W., and Vasconcelos, N. (2018, January 18–22). Cascade R-CNN: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
8. Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., and Chen, J. (2024, January 13–19). DETRs Beat YOLOs on Real-Time Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.01605 ↗
9. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C., and Berg, A.C. (2016, January 11–14). SSD: Single shot multibox detector. Proceedings of the 14th European Conference on Computer Vision 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
10. Redmon, J., Divvala, S.K., Girshick, R.B., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
11. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
12. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
13. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv.
14. Zhu, X.K., Lyu, S.C., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
15. (2024, November 02). Ultralytics: Yolov5. [EB/OL]. Available online: https://github.com/ultralytics/yolov5.
16. Real-time detection algorithm of helmet and reflective vest based on improved YOLOv510.1007/s11554-023-01268-w ↗
17. Wu, D.L., Jiang, S., Zhao, E.L., Liu, Y.L., Zhu, H.C., Wang, W.W., and Wang, R.Y. (2022). Detection of Camellia oleifera fruit in complex scenes by using YOLOv7 and data augmentation. Appl. Sci., 12.10.3390/app122211318 ↗
18. Jiang, K., Xie, T., Yan, R., Yan, R., Wen, X., Li, D., Jiang, H.B., Jiang, N., Feng, L., and Duan, X.L. (2022). An attention mechanism-improved YOLOv7 object detection algorithm for hemp duck count estimation. Agriculture, 12.10.3390/agriculture12101659 ↗
19. Li, B., Chen, Y., Xu, H., and Fei, Z. (2023). Fast vehicle detection algorithm on lightweight YOLOv7-tiny. arXiv.
20. Kulyukin, V.A., and Kulyukin, A.V. (2023). Accuracy vs. energy: An assessment of bee object inference in videos from on-hive video loggers with YOLOv3, YOLOv4-Tiny, and YOLOv7-Tiny. Sensors, 23.10.3390/s23156791 ↗
21. Chen, L., Liu, Z., Tong, L., Jiang, Z., Wang, S., Dong, J., and Zhou, H.Y. (2020, January 19–24). Underwater object detection using Invert Multi-Class Adaboost with deep learning. Proceedings of the 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK.10.1109/IJCNN48605.2020.9207506 ↗
22. Lin, W., Zhong, J., Liu, S., Li, T., and Li, G. (2020, January 4–8). Roimix: Proposal-fusion among multiple images for underwater object detection. Proceedings of the ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9053829 ↗
23. Scale-aware feature pyramid architecture for marine object detection10.1007/s00521-020-05217-7 ↗
24. Qi, S., Du, J., Wu, M., Yi, H., Tang, L., Qian, T., and Wang, X. (2022, January 22–27). Underwater small target detection based on deformable convolutional pyramid. Proceedings of the ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9746575 ↗
25. A quantitative detection algorithm based on improved Faster R-CNN for marine benthos10.1016/j.ecoinf.2021.101228 ↗
26. A case study of utilizing YOLOT based quantitative detection algorithm for marine benthos10.1016/j.ecoinf.2022.101603 ↗
27. Zhang, M., Xu, S., Song, W., He, Q., and Wei, Q. (2021). Lightweight underwater object detection based on YOLO v4 and multi-scale attentional feature fusion. Remote Sens., 13.10.3390/rs13224706 ↗
28. YWnet: A convolutional block attention-based fusion deep learning method for complex underwater small target detection10.1016/j.ecoinf.2023.102401 ↗
29. Wen, G., Li, S., Liu, F.C., Luo, X., Er, M., Mahmud, M., and Wu, T. (2023). YOLOv5s-CA: A modified YOLOv5s network with coordinate attention for underwater target detection. Sensors, 23.10.3390/s23073367 ↗
30. Marine zoobenthos recognition algorithm based on improved lightweight YOLOv510.1016/j.ecoinf.2024.102467 ↗
31. Research on underwater small target detection algorithm based on improved YOLOv710.1109/ACCESS.2023.3290903 ↗
32. An improved YOLOv5-based underwater object-detection framework10.3390/s23073693 ↗
33. Liu, K., Peng, L., and Tang, S. (2023). Underwater object detection using TC-YOLO with attention mechanisms. Sensors, 23.10.3390/s23052567 ↗
34. Wang, J., Li, Q., Fang, Z., Zhou, X., Tang, Z., Han, Y., and Ma, Z. (2023). YOLOv6-ESG: A lightweight seafood detection method. J. Mar. Sci. Eng., 11.10.3390/jmse11081623 ↗
35. Liu, K., Sun, Q., Sun, D., Peng, L., Yang, M., and Wang, N. (2023). Underwater target detection based on improved YOLOv7. J. Mar. Sci. Eng., 11.10.3390/jmse11030677 ↗
36. Real-time underwater object detection technology for complex underwater environments based on deep learning10.1016/j.ecoinf.2024.102680 ↗
37. A lightweight YOLOv8 integrating FasterNet for real-time underwater object detection10.1007/s11554-024-01431-x ↗
38. Qu, S., Cui, C., Duan, J., Lu, Y., and Pang, Z. (2024). Underwater small target detection under YOLOv8-LA model. Sci. Rep., 14.10.1038/s41598-024-66950-w ↗
39. Pan, W., Chen, J., Lv, B., and Peng, L. (2024). Optimization and Application of Improved YOLOv9s-UI for Underwater Object Detection. Appl. Sci., 14.10.3390/app14167162 ↗
40. Sun, Y., Zheng, W., Du, X., and Yan, Z. (2023). Underwater small target detection based on YOLOX combined with MobileViT and double coordinate attention. J. Mar. Sci. Eng., 11.10.3390/jmse11061178 ↗
41. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
42. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–22). Path Aggregation Network for Instance Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
43. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
44. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
45. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
46. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
47. Yang, L., Zhang, R.Y., Li, L., and Xie, X. (2021, January 18–24). SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks. Proceedings of the International Conference on Machine Learning, Virtual Event.
48. Ouyang, D., He, S., Zhang, G., Luo, M., Guo, H., Zhan, J., and Huang, Z. (2023, January 4–10). Efficient Multi-Scale Attention Module with Cross-Spatial Learning. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096516 ↗
49. Zhu, L., Wang, X., Ke, Z., Zhang, W., and Lau, R.W. (2023, January 17–24). Biformer: Vision Transformer with Bi-Level Routing Attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00995 ↗
50. Xia, Z., Pan, X., Song, S., Li, L.E., and Huang, G. (2022, January 18–24). Vision Transformer with Deformable Attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00475 ↗
51. Finder, S.E., Amoyal, R., Treister, E., and Freifeld, O. (October, January 29). Wavelet Convolutions for Large Receptive Fields. Proceedings of the European Conference on Computer Vision (ECCV), Milan, Italy.
52. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, MIT Press.
53. Gong, H., Mu, T., Li, Q., Dai, H., Li, C., He, Z., and Wang, B. (2022). Swin-Transformer-Enabled YOLOv5 with Attention Mechanism for Small Object Detection on Satellite Images. Remote Sens., 14.10.3390/rs14122861 ↗
54. Zhai, X., Huang, Z., Li, T., Liu, H., and Wang, S. (2023). YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection. Electronics, 12.10.3390/electronics12173664 ↗
55. Cui, Y., Ren, W., and Knoll, A. (2024, January 20–27). Omni-Kernel Network for Image Restoration. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.
56. Han, Y., Chen, L., Luo, Y., Ai, H., Hong, Z., Ma, Z., and Zhang, Y. (2022). Underwater Holothurian Target-Detection Algorithm Based on Improved CenterNet and Scene Feature Fusion. Sensors, 22.10.3390/s22197204 ↗
57. Rethinking General Underwater Object Detection: Datasets, Challenges, and Solutions10.1016/j.neucom.2022.10.039 ↗