journal article·2023-11-15Open access

Lightweight You Only Look Once v8: An Upgraded You Only Look Once v8 Algorithm for Small Object Identification in Unmanned Aerial Vehicle Images

Zhongmin Huangfu, Shuqing Li

Applied Sciences· Volume 13· Issue 22

Abstract

In order to solve the problems of high leakage rate, high false detection rate, low detection success rate and large model volume of small targets in the traditional target detection algorithm for Unmanned Aerial Vehicle (UAV) aerial images, a lightweight You Only Look Once (YOLO) v8 algorithm model Lightweight (LW)-YOLO v8 is proposed. By increasing the channel attention mechanism Squeeze-and-Excitation (SE) module, this method can adaptively improves the model’s ability to extract features from small targets; at the same time, the lightweight convolution technology is introduced into the Conv module, where the ordinary convolution is replaced by the GSConv module, which can effectively reduce the model computational volume; on the basis of the GSConv module, a single aggregation module VoV-GSCSPC is designed to optimize the model structure in order to achieve a higher computational cost-effectiveness. The experimental results show that the LW-YOLO v8 model’s mAP@0.5 metrics on the VisDrone2019 dataset are more favorable than those on the YOLO v8n model, improving by 3.8 percentage points, and the computational amount is reduced to 7.2 GFLOPs. The LW-YOLO v8 model proposed in this work can effectively accomplish the task of detecting small targets in aerial images from UAV at a lower cost.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Infrared Target Detection Methodologies · Robotics and Sensor-Based Localization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Engineering, North China University of Water Resources and Electric Power, Zhengzhou 450046, China

Funding

Higher Education Institutions in Henan Province, China · Science and Technology Research Projects in Henan Province, China

References (41)

Show source-provided references
1. Snyder, D., Garcia-Romero, D., Sell, G., Povey, D., and Khudanpur, S. (2018, January 15–20). X-vectors: Robust dnn embeddings for speaker recognition. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461375 ↗
2. Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv.10.3115/v1/D14-1181 ↗
3. Viola, P., and Jones, M. (2001, January 8–14). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, Kauai, HI, USA.
4. Object detection with discriminatively trained part-based models10.1109/TPAMI.2009.167 ↗
5. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
6. A review of yolo algorithm developments10.1016/j.procs.2022.01.135 ↗
7. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
8. Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2014). Striving for simplicity: The all convolutional net. arXiv.
9. Hu, J., Wang, Z., Chang, M., Xie, L., Xu, W., and Chen, N. (2022). Psg-yolov5: A paradigm for traffic sign detection and recognition algorithm based on deep learning. Symmetry, 14.10.3390/sym14112262 ↗
10. Li, H., Li, J., Wei, H., Liu, Z., Zhan, Z., and Ren, Q. (2022). Slim-neck by gsconv: A better design paradigm of detector architectures for autonomous vehicles. arXiv.
11. Target detection and localization using mimo radars and sonars10.1109/TSP.2006.879267 ↗
12. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
13. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
14. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
15. Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7–12). Faster r-cnn: Towards real-time object detection with region proposal networks. Proceedings of the Advances in Neural Information Processing Systems 28 (NIPS 2015), Montreal, QC, Canada.
16. Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5–10). R-fcn: Object detection via region-based fully convolutional networks. Proceedings of the 30th International Conference on Neural Information Processing Systems, Red Hook, NY, USA.
17. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
18. Ghiasi, G., Lin, T.-Y., and Le, Q.V. (2019, January 15–20). Nas-fpn: Learning scalable feature pyramid architecture for object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00720 ↗
19. A new lightweight deep neural network for surface scratch detection10.1007/s00170-022-10335-8 ↗
20. Jawaharlalnehru, A., Sambandham, T., Sekar, V., Ravikumar, D., Loganathan, V., Kannadasan, R., Khan, A.A., Wechtaisong, C., Haq, M.A., and Alhussen, A. (2022). Target object detection from unmanned aerial vehicle (uav) images based on improved yolo algorithm. Electronics, 11.10.3390/electronics11152343 ↗
21. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). Tph-yolov5: Improved yolov5 based on transformer prediction head for object detection on drone-captured scenarios. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
22. Finding nonrigid tiny person with densely cropped and local attention object detector networks in low-altitude aerial images10.1109/JSTARS.2022.3175498 ↗
23. Target detection in unmanned aerial vehicle images based on DSM-YOLO v5
24. Multi-scale void convolutional target detection method for unmanned aerial vehicle images
25. Real time object detection of unmanned aerial vehicle images based on improved yolov5s
26. Detection and identification of fish in electronic monitoring data of commercial fishing vessels based on improved Yolov8
27. Reis, D., Kupec, J., Hong, J., and Daoudi, A. (2023). Real-time flying object detection with Yolov8. arXiv.
28. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 18–22). Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
29. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
30. Lee, Y., Hwang, J.-W., Lee, S., Bae, Y., and Park, J. (2019, January 16–17). An energy and gpu-computation efficient backbone network for real-time object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00103 ↗
31. Wang, C.-Y., Liao, H.-Y.M., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., and Yeh, I.-H. (2020, January 14–19). Cspnet: A new backbone that can enhance learning capability of cnn. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Washington, DC, USA.10.1109/CVPRW50498.2020.00203 ↗
32. Gam, apoio e cuidado em caps ad
33. Lin, Z., Feng, M., Santos, C.N.D., Yu, M., Xiang, B., Zhou, B., and Bengio, Y. (2017). A structured self-attentive sentence embedding. arXiv.
34. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
35. Nascimento, M.G.D., Fawcett, R., and Prisacariu, V.A. (November, January 27). Dsconv: Efficient convolution operator. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
36. Zhu, X., Hu, H., Lin, S., and Dai, J. (2019, January 15–20). Deformable convnets v2: More deformable, better results. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00953 ↗
37. Li, Z., Peng, C., Yu, G., Zhang, X., Deng, Y., and Sun, J. (2018). Detnet: A backbone network for object detection. arXiv.10.1007/978-3-030-01240-3_21 ↗
38. Law, H., and Deng, J. (2018, January 8–14). Cornernet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_45 ↗
39. Yu, W., Yang, T., and Chen, C. (2021, January 3–8). Towards resolving the challenge of long-tail distribution in uav images for object detection. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV48630.2021.00330 ↗
40. Zhou, X., Wang, D., and Krähenbühl, P. (2019). Objects as points. arXiv.
41. Zhao, H., Zhou, Y., Zhang, L., Peng, Y., Hu, X., Peng, H., and Cai, X. (2020). Mixed yolov3-lite: A lightweight real-time object detection method. Sensors, 20.10.3390/s20071861 ↗