Adaptive Feature Fusion for Small Object Detection
Source abstract
Abstract
In order to alleviate the situation that small objects are prone to missed detection and false detection in natural scenes, this paper proposed a small object detection algorithm for adaptive feature fusion, referred to as MMF-YOLO. First, aiming at the problem that small object pixels are easy to lose, a multi-branch cross-scale feature fusion module with fusion factor was proposed, where each fusion path has an adaptive fusion factor, which can allow the network to independently adjust the importance of features according to the learned weights. Then, aiming at the problem that small objects are similar to background information and small objects overlap in complex scenes, the M-CBAM attention mechanism was proposed, which was added to the feature reinforcement extraction module to reduce feature redundancy. Finally, in light of the problem of small object size and large size span, the size of the object detection head was modified to adapt to the small object size. Experiments on the VisDrone2019 dataset showed that the mAP of the proposed algorithm could reach 42.23%, and the parameter quantity was only 29.33 MB, which is 9.13% ± 0.07% higher than the benchmark network mAP, and the network model was reduced by 5.22 MB.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Video Surveillance and Tracking Methods · Domain Adaptation and Few-Shot Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Southwest University of Science and Technology, Mianyang 621000, China
Sichuan Provincial Key Laboratory of Robotics for Special Environments, Southwest University of Science and Technology, Mianyang 621000, China
Funding
National Natural Science Foundation of China
References (45)
Show source-provided references
1. Multi-scale kernel correlation filter algorithm for visual tracking based on the fusion of adaptive features
2. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
3. Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, MIT Press.
4. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
5. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
6. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.
7. Redmon, J., and Farhadi, A. (USA, January Honolulu,). YOLO9000: Better, faster, stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 21–26 July 2017.10.1109/CVPR.2017.690 ↗
8. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
9. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
10. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE international conference on computer vision, IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
11. Research progress of small target detection
12. Microsoft COCO: Common objects in context10.1007/978-3-319-10602-1_48 ↗
13. Research progress of small target detection based on deep learning
14. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
15. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
16. R2 -CNN: Fast Tiny Object Detection in Large-Scale Remote Sensing Images10.1109/TGRS.2019.2899955 ↗
17. Yin, Z., Guiyi, Z., Tianjun, S., Kun, Z., and Junhua, Y. (2022). Small object detection in remote sensing images based on feature fusion and attention. J. Opt., 1–17. Available online: http://kns.cnki.net/kcms/detail/31.1252.O4.20220714.1843.456.html.
18. Jinkai, W., and Xijin, S. (2022). Review of Applied Research on Computer Vision Technology. Comput. Age, 1–4+8.
19. A review of deep learning methods for semantic segmentation of remote sensing imagery10.1016/j.eswa.2020.114417 ↗
20. Raghunandan, A., Raghav, P., and Ravish Aradhya, H.V. (2018, January 3–5). Object Detection Algorithms for Video Surveillance Applications. Proceedings of the 2018 International Conference on Communication and Signal Processing (ICCSP), Chennai, India.10.1109/ICCSP.2018.8524461 ↗
21. Identifying medical diagnoses and treatable diseases by image-based deep learning10.1016/j.cell.2018.02.010 ↗
22. Liu, S., Cai, T., Tang, X., Zhang, Y., and Wang, C. (2022). Visual recognition of traffic signs in natural scenes based on improved RetinaNet. Entropy, 24.10.3390/e24010112 ↗
23. PBNet: Part-based convolutional neural network for complex composite object detection in remote sensing imagery10.1016/j.isprsjprs.2020.12.015 ↗
24. Medical image fusion method by deep learning
25. Yu, X., Gong, Y., Jiang, N., Ye, Q., and Han, Z. (2020, January 1–5). Scale Match for Tiny Person Detection. Proceedings of the 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO, USA.10.1109/WACV45572.2020.9093394 ↗
26. Singh, B., and Davis, L.S. (2018, January 18–23). An analysis of scale invariance in object detection snip. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00377 ↗
27. Singh, B., Najibi, M., and Davis, L.S. (2018). Sniper: Efficient multi-scale training. Advances in Neural Information Processing Systems, MIT Press.
28. Extended feature pyramid network for small object detection10.1109/TMM.2021.3074273 ↗
29. Noh, J., Bae, W., Lee, W., Seo, J., and Kim, G. (2019, January 27–28). Better to follow, follow to be better: Towards precise supervision of feature super-resolution for small object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00982 ↗
30. Chen, Y., Zhang, P., Li, Z., and Li, Y. (2020). Stitcher: Feedback-driven data provider for object detection. arXiv.
31. Li, Y., Chen, Y., Wang, N., and Zhang, Z. (2019, January 27–28). Scale-aware trident networks for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00615 ↗
32. CAD-Net: A context-aware detection network for objects in remote sensing imagery10.1109/TGRS.2019.2930982 ↗
33. Zhao, Q., Sheng, T., Wang, Y., Tang, Z., Chen, Y., Cai, L., and Ling, H. (2019, January 8–12). M2Det: A single-shot object detector based on multi-level feature pyramid network. Proceedings of the AAAI Conference on Artificial Intelligence, Atlanta, GA, USA.10.1609/aaai.v33i01.33019259 ↗
34. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). Efficientdet: Scalable and efficient object detection. In Proceedings of The IEEE/CVF Conference on Computer Vision And Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
35. Liu, S., Huang, D., and Wang, Y. (2019). Learning spatial fusion for single-shot object detection. arXiv.
36. Gong, Y., Yu, X., Ding, Y., Peng, X., Zhao, J., and Han, Z. (2021, January 5–9). Effective fusion factor in FPN for tiny object detection. Proceedings of the IEEE/CVF winter conference on applications of computer vision, Virtual Conference.10.1109/WACV48630.2021.00120 ↗
37. Bochkovskiy, A., Wang, C.Y., and Liao, H. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv.
38. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
39. Hou, Q., and Zhou, D.F. (2021, January 20–25). Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
40. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European conference on computer vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
41. Zhu, P.F., Wen, L., Du, D., Bian, X., Ling, H., Hu, Q., Nie, Q., Cheng, H., Liu, C., and Liu, X. (2019, January 27–28). VisDrone-DET2019: The vision meets drone object detection in image challenge results. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, Seoul, Korea.10.1109/ICCVW.2019.00031 ↗
42. Yu, W.P., Yang TJ, N., and Chen, C. (2021, January 5–9). Towards Resolving the Challenge of Long-tail Distribution in UAV Images for Object Detection. Proceedings of the 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Virtual.10.1109/WACV48630.2021.00330 ↗
43. Small target detection algorithm for UAV aerial imagery based on enhanced underlying features
44. Ali, S., Siddique, A., Ateş, H.F., and Güntürk, B.K. (2021, January 9–11). Improved YOLOv4 for aerial object detection. Proceedings of the 2021 29th Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkye.10.1109/SIU53274.2021.9478027 ↗
45. Zhao, H., Zhou, Y., Zhang, L., Peng, Y., Hu, X., Peng, H., and Cai, X. (2020). Mixed YOLOv3-LITE: A Lightweight Real-Time Object Detection Method. Sensors, 20.10.3390/s20071861 ↗