journal article·2023-09-18Open access

PBA-YOLOv7: An Object Detection Method Based on an Improved YOLOv7 Network

Yang Sun, Yi Li, Song Li, Zehao Duan, Haonan Ning, Yuhang Zhang

Applied Sciences· Volume 13· Issue 18

Abstract

Deep learning-based object detection methods address the problem of how to trade off the object detection accuracy and detection speed of the model. This paper proposes the PBA-YOLOv7 network algorithm, which is based on the YOLOv7 network, and first introduces the PConv, which lightens the ELAN module in the backbone network structure and reduces the number of parameters to improve the detection speed of the network and then designs and introduces the BiFusionNet network, which better aggregates the high-level semantic features and the low-level semantic features; and finally, on this basis, the coordinate attention mechanism is introduced to make the network focus on more critical features without increasing the model complexity. The coordinate attention mechanism is introduced to make the network focus more on important feature information and improve the feature expression ability of the network without increasing the model complexity. Experiments on the publicly available KITTI’s dataset show that the PBA-YOLOv7 network model significantly improves both detection accuracy and detection speed compared to the original YOLOv7 model, with 4% and 7.8% improvement in mAP0.5 and mAP0.5:0.95, respectively, and six frames improvement in FPS. The improved algorithm in this paper weighs the model’s detection accuracy and detection speed in the detection task. It performs well compared to other algorithms, such as YOLOv7 and YOLOv5l.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan 056038, China

Funding

Natural Science Foundation of Hebei Province

References (38)

Show source-provided references
1. The challenges of autonomous driving
2. Distinctive image features from scale-invariant key points10.1023/B:VISI.0000029664.99615.94 ↗
3. Dalal, N., and Triggs, B. (2005, January 20–26). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA.
4. Felzenszwalb, P., McAllester, D., and Ramanan, D. (2008, January 23–28). A discriminatively trained, multiscale, deformable part model. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.10.1109/CVPR.2008.4587597 ↗
5. Support vector machines10.1109/5254.708428 ↗
6. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
7. Wang, P., Bayram, B., and Sertel, E. (2022). A comprehensive review on deep learning based remote sensing image super-resolution methods. Earth-Sci. Rev., 232.10.1016/j.earscirev.2022.104110 ↗
8. Bharati, P., and Pramanik, A. (2020). Computational Intelligence in Pattern Recognition: Proceedings of CIPR 2019, Available online: https://www.researchgate.net/publication/338302306_Computational_Intelligence_in_Pattern_Recognition_Proceedings_of_CIPR_2019_Proceedings_of_CIPR_2019.
9. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
10. Ren, S., He, K., and Girshick, R. (2023, September 13). Faster r-cnn: Towards real-time object detection with region proposal networks. Available online: https://arxiv.org/abs/1506.01497.
11. He, K., Gkioxari, G., and Dollár, P. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
12. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
13. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
14. A Review of Yolo algorithm developments10.1016/j.procs.2022.01.135 ↗
15. Liu, W., Anguelov, D., and Erhan, D. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the Computer Vision–ECCV, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
16. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
17. Real-time detection of kiwifruit flower and bud simultaneously in orchard using YOLOv4 for robotic pollination10.1016/j.compag.2021.106641 ↗
18. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
19. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
20. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
21. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
22. Yan, B., Fan, P., Lei, X.Y., Liu, Z.J., and Yang, F.Z. (2021). A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5. Remote Sens., 13.10.3390/rs13091619 ↗
23. A real-time object detection algorithm for video10.1016/j.compeleceng.2019.05.009 ↗
24. Deep generative inpainting with comparative sample augmentation
25. A hybrid CNN for image denoising
26. Deep image retrieval using artificial neural network interpolation and indexing based on similarity measurement10.1049/cit2.12083 ↗
27. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 18–22). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
28. Wang, K., Liew, J.H., and Zou, Y. (November, January 27). Panet: Few-shot image semantic segmentation with prototype alignment. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
29. Ding, X.H., Zhang, X.Y., Ma, N.N., Han, J.G., Ding, G.G., and Sun, J. (2021). RepVGG: Making VGG-style ConvNets Great Again. arXiv.10.1109/CVPR46437.2021.01352 ↗
30. Ding, X.H., Hao, T.X., Tan, J.C., Liu, J., Han, J.G., Guo, Y.C., and Ding, G.G. (2021). ResRep: Lossless CNN Pruning via Decoupling Remembering. arXiv.10.1109/ICCV48922.2021.00447 ↗
31. Chen, J., Kao, S., and He, H. (2023, January 18–22). Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01157 ↗
32. Zhang, X., Zeng, H., and Guo, S. (2022). Computer Vision–ECCV, Springer Nature.
33. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
34. Lee, Y., Hwang, J., and Lee, S. (2019, January 16–17). An energy and GPU-computation efficient backbone network for real-time object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00103 ↗
35. Wang, C.Y., Liao, H.Y.M., and Wu, Y.H. (2020, January 13–19). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00203 ↗
36. Li, C., Li, L., and Geng, Y. (2023). YOLOv6 v3. 0: A Full-Scale Reloading. arXiv.
37. A review on the attention mechanism of deep learning10.1016/j.neucom.2021.03.091 ↗
38. Identification and Analysis of Emergency Behavior of Cage-Reared Laying Ducks Based on YoloV510.3390/agriculture12040485 ↗