A Hybrid Feature Fusion Traffic Sign Detection Algorithm Based on YOLOv7
Source abstract
Abstract
Autonomous driving technology has entered a period of rapid development, and traffic sign detection is one of the important tasks. Existing target detection networks are difficult to adapt to scenarios where target sizes are seriously imbalanced, and traffic sign targets are small and have unclear features, which makes detection more difficult. Therefore, we propose a Hybrid Feature Fusion Traffic Sign detection algorithm based on YOLOv7 (HFFT-YOLO). First, a self-attention mechanism is incorporated at the end of the backbone network to calculate feature interactions within scales; Secondly, the cross-scale fusion part of the neck introduces a bottom-up multi-path fusion method. Design reuse paths at the end of the neck, paying particular attention to cross-scale fusion of high-level features. In addition, we found the appropriate channel width through a lot of experiments and reduced the superfluous parameters. In terms of training, a new regression loss CMPDIoU is proposed, which not only considers the problem of loss degradation when the aspect ratio is the same but the width and height are different, but also enables the penalty term to dynamically change at different scales. Finally, our proposed improved method shows excellent results on the TT100K dataset. Compared with the baseline model, without increasing the number of parameters and computational complexity, and increased by 2.2% and 2.7%, respectively, reaching 92.9% and 58.1%.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Infrastructure Maintenance and Monitoring · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (30)
Show source-provided references
1. Attention is all you need
2. Faster R-CNN: Towards real-time object detection with region proposal networks
3. SSD: Single shot multibox detector
4. You only look once: Unified, real-time object detection
5. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
6. STC-YOLO: Small object detection network for traffic signs in complex environments10.3390/s23115307 ↗
7. An improved lightweight small object detection framework applied to real-time autonomous driving10.1016/j.eswa.2023.121036 ↗
8. UCN-YOLOv5: Traffic sign target detection algorithm based on deep learning10.1109/ACCESS.2023.3322371 ↗
9. A small object detection algorithm for traffic signs based on improved YOLOv710.3390/s23249906 ↗
10. Real-time detection network for tiny traffic sign using multi-scale attention module10.1007/s11431-021-1950-9 ↗
11. Traffic sign detection and recognition using multi-frame embedding of video-log images
12. Improved YOLOv5 network for real-time multi-scale traffic sign detection10.1007/s00521-022-08077-5 ↗
13. YOLOv7-TS: A traffic sign detection model based on sub-pixel convolution and feature fusion
14. CR-YOLOv8: Multiscale object detection in traffic sign images10.1109/ACCESS.2023.3347352 ↗
15. A lightweight network for traffic sign recognition based on multi-scale feature and attention mechanism
16. Rich feature hierarchies for accurate object detection and semantic segmentation
17. UnitBox: An advanced object detection network
18. Generalized intersection over union: A metric and a loss for bounding box regression
19. Distance-IoU loss: Faster and better learning for bounding box regression
20. Focal and efficient IOU loss for accurate bounding box regression10.1016/j.neucom.2022.07.042 ↗
21. Z. Tong, Y. Chen, Z. Xu, and R. Yu, “Wise-IoU: Bounding box regression loss with dynamic focusing mechanism,” arXiv preprint arXiv:2301.10051, 2023.
22. BiFormer: Vision transformer with bi-level routing attention
23. A. Dosovitskiy et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2020.11929, 2010.
24. A review on the attention mechanism of deep learning10.1016/j.neucom.2021.03.091 ↗
25. X. Xu, Y. Jiang, W. Chen, Y. Huang, Y. Zhang, and X. Sun, “DAMO-YOLO: A report on real-time object detection design,” arXiv preprint arXiv:2211.15444, 2022.
26. J. Lin et al., “D2ETR: Decoder-only DETR with computationally efficient cross-scale attention,” arXiv preprint arXiv:2203.00860, 2022.
27. W. Lv et al., “Detrs beat yolos on real-time object detection,” arXiv preprint arXiv:2304.08069, 2023.
28. S. Ma and Y. Xu, “MPDIoU: A loss for efficient and accurate bounding box regression,” arXiv preprint arXiv:2307.07662, 2023.
29. J. Wang, C. Xu, W. Yang, and L. Yu, “A normalized Gaussian Wasserstein distance for tiny object detection,” arXiv preprint arXiv:2110.13389, 2021.
30. Traffic-sign detection and classification in the wild