Real-Time Target Detection System for Animals Based on Self-Attention Improvement and Feature Extraction Optimization
Source abstract
Abstract
In this paper, we propose a wildlife detection algorithm based on improved YOLOv5s by combining six real wildlife images of different sizes and forms as datasets. Firstly, we use the RepVGG model to simplify the network structure that integrates the ideas of VGG and ResNet. This RepVGG introduces a structural reparameterization approach to ensure model flexibility while reducing the computational effort. This not only enhances the ability of model feature extraction but also speeds up the model computation, further improving the model’s real-time performance. Secondly, we use the sliding window method of the Swin Transformer module to divide the feature map to speed up the convergence of the model and improve the real-time performance of the model. Then, it introduces the C3TR module to segment the feature map, expand the perceptual field of the feature map, solve the problem of backpropagation gradient disappearance and gradient explosion, and enhance the feature extraction and feature fusion ability of the model. Finally, the model is improved by using SimOTA, a positive and negative sample matching strategy, by introducing the cost matrix to obtain the highest accuracy with the minimum cost. The experimental results show that the improved YOLOv5s algorithm proposed in this paper improves mAP by 3.2% and FPS by 11.9 compared with the original YOLOv5s algorithm. In addition, the detection accuracy and detection speed of the improved YOLOv5s model in this paper have obvious advantages in terms of the detection effects of other common target detection algorithms on the animal dataset in this paper, which proves that the improved effectiveness and superiority of the improved YOLOv5s target detection algorithm in animal target detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Video Surveillance and Tracking Methods · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Science, Wuhan University of Technology, Wuhan 430070, China
Funding
National Natural Science Foundation of China · National Innovation and Entrepreneurship Training Program for College Students, China
References (45)
Show source-provided references
1. Ding, F., Zhuang, Z., Liu, Y., Jiang, D., Yan, X., and Wang, Z. (2020). Detecting Defects on Solid Wood Panels Based on an Improved SSD Algorithm. Sensors, 20.10.3390/s20185315 ↗
2. Gagandeep Effective network intrusion detection by addressing class imbalance with deep neural networks multimedia tools and applications10.1007/s11042-021-11747-6 ↗
3. An Automated Mammals Detection Based on SSD-Mobile Net10.1088/1742-6596/1879/2/022086 ↗
4. Monitoring of pet animal in smart cities using animal biometrics10.1016/j.future.2016.12.006 ↗
5. Graph Neural Network for Traffic Forecasting: A Survey10.1016/j.eswa.2022.117921 ↗
6. Rodríguez-Rangel, H., Morales-Rosales, L.A., Imperial-Rojo, R., Roman-Garay, M.A., Peralta-Peñuñuri, G.E., and Lobato-Báez, M. (2022). Analysis of Statistical and Artificial Intelligence Algorithms for Real-Time Speed Estimation Based on Vehicle Detection with YOLO. Appl. Sci., 12.10.3390/app12062907 ↗
7. Lee, J.-D., Chien, J.-C., Hsu, Y.-T., and Wu, C.-T. (2021). Automatic Surgical Instrument Recognition—A Case of Comparison Study between the Faster R-CNN, Mask R-CNN, and Single-Shot Multi-Box Detectors. Appl. Sci., 11.10.3390/app11178097 ↗
8. TransRPN: Towards the Transferable Adversarial Perturbations using Region Proposal Networks and Beyond10.1016/j.cviu.2021.103302 ↗
9. Redmon, J., Divvala, S.K., Girshick, R.B., and Farhadi, A. (2015, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
10. Redmon, J., and Farhadi, A. (2016, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
11. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
12. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
13. (2022, November 22). YOLOv5 SOTA Realtime Instance Segmentation. Available online: https://github.com/ultralytics/yolov5.
14. Automated Detection and Classification of Pavement Distresses using 3D Pavement Surface Images and Deep Learning10.1177/03611981211007481 ↗
15. Farzaneh, D.J., Farhad, S., Mehrnaz, G., and Farnaz, A.M. (2022). A Modified YOLOv4 Deep Learning Network for Vision-Based UAV Recognition. Drones, 6.10.3390/drones6070160 ↗
16. Wang, Q., Zhang, Q., Liang, X., Wang, Y., Zhou, C., and Mikulovich, V.I. (2021). Traffic Lights Detection and Recognition Method Based on the Improved YOLOv4 Algorithm. Sensors, 22.10.3390/s22010200 ↗
17. Li, X., Wang, C., Ju, H., and Li, Z. (2022). Surface Defect Detection Model for Aero-Engine Components Based on Improved YOLOv5. Appl. Sci., 12.10.3390/app12147235 ↗
18. Yan, B., Fan, P., Lei, X., Liu, Z., and Yang, F. (2021). A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5. Remote Sens., 13.10.3390/rs13091619 ↗
19. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 20–25). RepVGG: Making VGG-style ConvNets Great Again. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01352 ↗
20. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Virtual Event.10.1109/ICCV48922.2021.00986 ↗
21. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv.
22. Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is All you Need. arXiv.
23. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
24. Lu, Y., Qiu, Z., Liao, C., Zhou, Z., Li, T., and Wu, Z. (2022). A GIS Partial Discharge Defect Identification Method Based on YOLOv5. Appl. Sci., 12.10.3390/app12168360 ↗
25. Qiao, G., Yang, M., and Wang, H. (2022). A Water Level Measurement Approach Based on YOLOv5s. Sensors, 22.10.3390/s22103714 ↗
26. Sozzi, M., Cantalamessa, S., Cogato, A., Kayad, A., and Marinello, F. (2022). Automatic Bunch Detection in White Grape Varieties Using YOLOv3, YOLOv4, and YOLOv5 Deep Learning Algorithms. Agronomy, 12.10.3390/agronomy12020319 ↗
27. FA-YOLO: An Improved YOLO Model for Infrared Occlusion Object Detection under Confusing Background10.1155/2021/1896029 ↗
28. Wang, J., Chen, Y., Gao, M., and Dong, Z. (2021). Improved YOLOv5 network for real-time multi-scale traffic sign detection. arXiv.10.1007/s00521-022-08077-5 ↗
29. Investigating the efficiency of deep learning based security system in a real-time environment using YOLOv5
30. Jia, Z., Wang, K., Li, Y., Liu, Z., Qin, J., and Yang, Q. (2022). High Precision Feature Fast Extraction Strategy for Aircraft Attitude Sensor Fault Based on RepVGG and SENet Attention Mechanism. Sensors, 22.10.3390/s22249662 ↗
31. Sandler, M., Howard, A.G., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
32. Huang, G., Liu, Z., and Weinberger, K.Q. (2016, January 21–26). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
33. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2019, January 15–20). GhostNet: More Features From Cheap Operations. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR42600.2020.00165 ↗
34. Wu, Q., Zhang, B., Xu, C., Zhang, H., and Wang, C. (2022). Dense Oil Tank Detection and Classification via YOLOX-TR Network in Large-Scale SAR Images. Remote Sens., 14.10.3390/rs14143246 ↗
35. Xie, X., and Shen, X. (2022). Convolutional Network Research for Defect Identification of Productor Appearance Surface. Electronics, 11.10.3390/electronics11244218 ↗
36. Xu, W., Zhang, C., Wang, Q., and Dai, P. (2022). FEA-Swin: Foreground Enhancement Attention Swin Transformer Network for Accurate UAV-Based Dense Object Detection. Sensors, 22.10.3390/s22186993 ↗
37. Al Rahhal, M.M., Bazi, Y., Jomaa, R.M., AlShibli, A., Alajlan, N., Mekhalfi, M.L., and Melgani, F. (2022). COVID-19 Detection in CT/X-ray Imagery Using Vision Transformers. J. Pers. Med., 12.10.3390/jpm12020310 ↗
38. Yang, S., Song, F., Jeon, G., and Sun, R. (2022). Scene Changes Understanding Framework Based on Graph Convolutional Networks and Swin Transformer Blocks for Monitoring LCLU Using High-Resolution Remote Sensing Images. Remote Sens., 14.10.3390/rs14153709 ↗
39. Liang, J., Cao, J., Sun, G., Zhang, K., Gool, L.V., and Timofte, R. (2021, January 11–17). SwinIR: Image Restoration Using Swin Transformer. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.10.1109/ICCVW54120.2021.00210 ↗
40. A method of citrus epidermis defects detection based on an improved YOLOv510.1016/j.biosystemseng.2023.01.018 ↗
41. Zhang, J., Peng, H., Wu, K., Liu, M., Xiao, B., Fu, J., and Yuan, L. (2022, January 18–24). MiniViT: Compressing Vision Transformers with Weight Multiplexing. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01183 ↗
42. Gu, Y., Wang, Q., and Qin, X. (2021, January 22–24). Real-time streaming perception system for autonomous driving. Proceedings of the 2021 China Automation Congress (CAC), Beijing, China.10.1109/CAC53003.2021.9728221 ↗
43. Dai, M., Dorjoy, M.M.H., Miao, H., and Zhang, S. (2023). A New Pest Detection Method Based on Improved YOLOv5m. Insects, 14.10.3390/insects14010054 ↗
44. Ge, Z., Liu, S., Li, Z., Yoshie, O., and Sun, J. (2021, January 20–25). OTA: Optimal Transport Assignment for Object Detection. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00037 ↗
45. Hong, Q., Liu, F., Li, D., Liu, J., Tian, L., and Shan, Y. (2022, January 18–24). Dynamic Sparse R-CNN. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00468 ↗