An Intelligent Weighted Object Detector for Feature Extraction to Enrich Global Image Information
Source abstract
Abstract
Object detection is a fundamental task in computer vision. To improve the detection accuracy of a detection model without increasing the model weights, this paper modifies the YOLOX model by first replacing some of the traditional convolution operations in the backbone network to reduce the parameter cost of generating feature maps. We design a local feature extraction module to chunk the feature maps to obtain local image features and a global feature extraction module to calculate the correlation between feature points to enrich the feature, and add learnable weights to the feature layers involved in the final prediction to assist the model in detection. Moreover, the idea of feature map reuse is proposed to retain more information from the high-dimensional feature maps. In comparison experiments on the dataset PASCAL VOC 2007 + 2012, the accuracy of the improved algorithm increased by 1.2% over the original algorithm and 2.2% over the popular YOLOv5.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science, Hubei University of Technology, Wuhan 430068, China
Department of Mathematics and Computer Science, Northeastern State University, Tahlequah, OK 74464, USA
Funding
National Natural Science Foundation of China · Key R&D plan of Hubei Province
References (47)
Show source-provided references
1. Ant Colony Optimization-Based Location-Aware Routing for Wireless Sensor Networks
2. An energy-efficient sleep scheduling mechanism with similarity measure for wireless sensor networks10.1186/s13673-018-0141-x ↗
3. Exploring finger vein based personal authentication for secure IoT10.1016/j.future.2017.07.013 ↗
4. Gao, K., and Han, F. (2019). Connected Vehicle as a Mobile Sensor for Real Time Queue Length at Signalized Intersections. Sensors, 19.10.3390/s19092059 ↗
5. A Pedestrian Detection Method Based on Genetic Algorithm for Optimize XGBoost Training Parameters10.1109/ACCESS.2019.2936454 ↗
6. Hybrid neural networks based facial expression recognition for smart city10.1007/s11042-021-11530-7 ↗
7. A review of object detection based on deep learning10.1007/s11042-020-08976-6 ↗
8. A device for effective weed removal for smart agriculture using convolutional neural network10.1007/s13198-021-01441-z ↗
9. Zhang, H., Wang, Y., Dayoub, F., and Sünderhauf, N. (2021, January 20–25). VarifocalNet: An IoU-aware Dense Object Detector. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00841 ↗
10. Zhou, X., Koltun, V., and Krähenbühl, P. (2021). Probabilistic Two-Stage Detection. arXiv.
11. Ge, Z., Liu, S., Wang, F., and Li, Z. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv.
12. Zhu, X., Su, W., Lu, L., and Li, B. (2021). Deformable DETR: Deformable Transformers for End-to-End Object Detection. arXiv.
13. Zhu, X., Lyu, S., Wang, X., and Zhao, Q. (2021, January 11–17). TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.10.1109/ICCVW54120.2021.00312 ↗
14. Yang, Z., Liu, S., Hu, H., Wang, L., and Lin, S. (November, January 27). RepPoints: Point Set Representation for Object Detection. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, Seoul, Korea.10.1109/ICCV.2019.00975 ↗
15. Deep learning-based object detection in low-altitude UAV datasets: A survey10.1016/j.imavis.2020.104046 ↗
16. Enhanced network optimized generative adversarial network for image enhancement10.1007/s11042-020-10310-z ↗
17. Huang, G., Liu, S., Van der Maaten, L., and Weinberger, K.Q. (2018, January 18–23). CondenseNet: An Efficient DenseNet Using Learned Group Convolutions. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00291 ↗
18. Sandler, M., Howard, A., Zhu, M., and Zhmoginov, A. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
19. Howard, A., Sandler, M., Chen, B., and Wang, W. (November, January 27). Searching for MobileNetV3. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00140 ↗
20. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18–23). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00716 ↗
21. Ma, N., Zhang, X., Zheng, H., and Sun, J. (2018, January 9). ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design. Proceedings of the European Conference on Computer Vision 2018, Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
22. Tan, M., and Le, Q.V. (2019). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. arXiv.
23. Tan, M., and Le, Q.V. (2021). EfficientNetV2: Smaller Models and Faster Training. arXiv.
24. Zhang, H., Wu, C., and Zhang, Z. (2020). ResNeSt: Split-Attention Networks. arXiv.
25. Han, K., Wang, Y., Tian, Q., and Guo, J. (2020, January 13–19). GhostNet: More Features From Cheap Operations. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00165 ↗
26. Yang, L., Jiang, H., Cai, R., Wang, Y., Song, S., Huang, G., and Tian, Q. (2021, January 20–25). CondenseNet V2: Sparse Feature Reactivation for Deep Networks. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00357 ↗
27. Han, D., Yun, S., Heo, B., and Yoo, Y. (2020). Rethinking Channel Dimensions for Efficient Model Design. arXiv.10.1109/CVPR46437.2021.00079 ↗
28. Wang, G., Yuan, Y., Chen, X., and Li, J. (2018, January 15). Learning Discriminative Features with Multiple Granularities for Person Re-Identification. Proceedings of the 26th ACM International Conference on Multimedia, New York, NY, USA.10.1145/3240508.3240552 ↗
29. Hu, H., Zhang, Z., Xie, Z., and Lin, S. (November, January 27). Local Relation Networks for Image Recognition. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00356 ↗
30. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local Neural Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
31. Carion, N., Massa, F., and Synnaeve, G. (2020). End-to-End Object Detection with Transformers. arXiv.10.1007/978-3-030-58452-8_13 ↗
32. Chen, Y., Dai, X., Chen, D., Liu, M., Dong, X., Yuan, L., and Liu, Z. (2021). Mobile-Former: Bridging MobileNet and Transformer. arXiv.10.1109/CVPR52688.2022.00520 ↗
33. Yang, Z., Li, Z., Jiang, X., Gong, Y., Yuan, Z., Zhao, D., and Yuan, C. (2022). Focal and Global Knowledge Distillation for Detectors. arXiv.10.1109/CVPR52688.2022.00460 ↗
34. Sun, J., Shen, Z., Wang, Y., Bao, H., and Zhou, X. (2021). LoFTR: Detector-Free Local Feature Matching with Transformers. arXiv.10.1109/CVPR46437.2021.00881 ↗
35. Sun, P., Zhang, R., Jiang, Y., Kong, T., Xu, C., Zhan, W., Tomizuka, M., Li, L., Yuan, Z., and Wang, C. (2021, January 20–25). Sparse R-CNN: End-to-End Object Detection with Learnable Proposals. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01422 ↗
36. Lin, T.-Y., Dollár, P., Girshick, R., and He, K. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
37. Liu, S., Qi, L., Qin, H., and Shi, J. (2018, January 18–23). Path Aggregation Network for Instance Segmentation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
38. Zhao, Q., Sheng, T., Wang, Y., and Tang, Z. (2019, January 27). M2Det: A Single-Shot Object Detector Based on Multi-Level Feature Pyramid Network. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.10.1609/aaai.v33i01.33019259 ↗
39. Liu, S., Huang, D., and Wang, Y. (2019). Learning Spatial Fusion for Single-Shot Object Detection. arXiv.
40. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
41. Guo, C., Fan, B., Zhang, Q., Xiang, S., and Pan, C. (2020, January 13–19). AugFPN: Improving Multi-scale Feature Learning for Object Detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01261 ↗
42. Zhang, D., Zhang, H., Tang, J., Wang, M., Hua, X., and Sun, Q. (2020, January 23–28). Feature Pyramid Transformer. Proceedings of the 16th European Conference on Computer Vision(ECCV), Glasgow, UK.10.1007/978-3-030-58604-1_20 ↗
43. Chen, Q., Wang, Y., Yang, T., Zhang, X., Cheng, J., and Sun, J. (2021). You Only Look One-level Feature. arXiv.10.1109/CVPR46437.2021.01284 ↗
44. Krishna, H., and Jawahar, C.V. (2017, January 26–29). Improving Small Object Detection. Proceedings of the 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR), Nanjing, China.10.1109/ACPR.2017.149 ↗
45. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
46. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal Loss for Dense Object Detection. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.324 ↗
47. Zhou, X., Wang, D., and Krähenbühl, P. (2019). Objects as Points. arXiv.