Robust Frontal Vehicle Pose Estimation Based on Structural Parameter Optimization Using Reliable Edge Point Sequences
Source abstract
Abstract
In order to enhance the stability of vehicle pose estimation within driving videos, a novel methodology for optimizing vehicle structural parameters is introduced. This approach hinges on evaluating the reliability of edge point sequences. Firstly, a multi−task and iterative convolutional neural network (MI−CNN) is constructed, enabling the simultaneous execution of four critical tasks: vehicle detection, yaw angle prediction, edge point location, and visibility assessment. Secondly, an imperative aspect of the methodology involves establishing a local tracking search area. This region is determined by modeling the limitations of vehicle displacement between successive frames. Vehicles are matched using a maximization approach that leverages point similarity. Finally, a reliable edge point sequence plays a pivotal role in resolving structural parameters robustly. The Gaussian mixture distribution of vehicle distance change ratios, derived from two measurement models, is employed to ascertain the reliability of the edge point sequence. The experimental results showed that the mean Average Precision (mAP) achieved by the MI−CNN network stands at 89.9%. A noteworthy observation is that the proportion of estimated parameters whose errors fall below the threshold of 0.8 m consistently surpasses the 85% mark. When the error threshold is set at less than 0.12 m, the proportion of estimated parameters meeting this criterion consistently exceeds 90%. Therefore, the proposed method has better application status and estimation precision.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autonomous Vehicle Technology and Safety · Advanced Vision and Imaging · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
Shanghai Smart Vehicle Cooperating Innovation Center Co., Ltd., Shanghai 201805, China
Guoqi (Beijing) Intelligent Network United Automobile Research Institute Co., Ltd., Beijing 102600, China
Funding
National Key Research and Development Program of China · National Natural Science Foundation of China
References (31)
Show source-provided references
1. Towards real-time object detection with region proposal networks
2. A review of sensor technologies for perception in automated driving10.1109/MITS.2019.2907630 ↗
3. Dey, R., Pandit, B.K., Ganguly, A., Chakraborty, A., and Banerjee, A. (2023, January 4–6). Deep Neural Network Based Multi-Object Detection for Real-time Aerial Surveillance. Proceedings of the 2023 11th International Symposium on Electronic Systems Devices and Computing (ESDC), Sri City, India.10.1109/ESDC56251.2023.10149866 ↗
4. A comparative study of state-of-the-art deep learning algorithms for vehicle detection10.1109/MITS.2019.2903518 ↗
5. Nesti, T., Boddana, S., and Yaman, B. (2023, January 17–24). Ultra-Sonic Sensor Based Object Detection for Autonomous Vehicles. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00026 ↗
6. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
7. Refinenet: Refining object detectors for autonomous driving10.1109/TIV.2017.2695896 ↗
8. Optimal feed forward neural network based automatic moving vehicle detection system in traffic surveillance system10.1007/s11042-020-08757-1 ↗
9. Dong, W., Yang, Z., Ling, W., Yonghui, Z., Ting, L., and Xiaoliang, Q. (2019, January 28–30). Research on vehicle detection algorithm based on convolutional neural network and combining color and depth images. Proceedings of the 2019 2nd International Conference on Information Systems and Computer Aided Education (ICISCAE), Dalian, China.10.1109/ICISCAE48440.2019.221634 ↗
10. Selective search for object recognition10.1007/s11263-013-0620-5 ↗
11. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
12. Cao, Z., Simon, T., Wei, S.-E., and Sheikh, Y. (2017, January 21–26). Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.143 ↗
13. Stein, G.P., Mano, O., and Shashua, A. (2000, January 5). A robust method for computing vehicle ego-motion. Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No. 00TH8511), Dearborn, MI, USA.
14. Method of vehicle distance measurement for following car based on monocular vision
15. An integrated longitudinal and lateral vehicle following control system with radar and vehicle-to-vehicle communication10.1109/TVT.2018.2890418 ↗
16. Towards a complete safety framework for longitudinal driving10.1109/TIV.2022.3209910 ↗
17. A sample update-based convolutional neural network framework for object detection in large-area remote sensing images10.1109/LGRS.2018.2889247 ↗
18. Optical-flow-based framework to boost video object detection performance with object enhancement10.1016/j.eswa.2020.114544 ↗
19. HyNet: Hyper-scale object detection network framework for multiple spatial resolution remote sensing imagery10.1016/j.isprsjprs.2020.04.019 ↗
20. Overview of object detection algorithms using convolutional neural networks
21. Novak, L. (2017). Vehicle Detection and Pose Estimation for Autonomous Driving. [Masters Thesis, Czech Technical University].
22. Wang, X., Hua, X., Xiao, F., Li, Y., Hu, X., and Sun, P. (2018). Multi-object detection in traffic scenes based on improved SSD. Electronics, 7.10.3390/electronics7110302 ↗
23. Chabot, F., Chaouch, M., Rabarisoa, J., Teuliere, C., and Chateau, T. (2017, January 21–26). Deep manta: A coarse-to-fine many-task network for joint 2d and 3d vehicle analysis from monocular image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.198 ↗
24. A new spatial-oriented object detection framework for remote sensing images
25. Gupta, D., Artacho, B., and Savakis, A. (2021, January 1–5). VehiPose: A multi-scale framework for vehicle pose estimation. Proceedings of the Applications of Digital Image Processing XLIV, San Diego, CA, USA.10.1117/12.2595800 ↗
26. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
27. Recognition of vehicle high beams based on multi-structure feature extraction and path tracking
28. Xiang, Y., Choi, W., Lin, Y., and Savarese, S. (2017, January 24–31). Subcategory-aware convolutional neural networks for object proposals and detection. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.10.1109/WACV.2017.108 ↗
29. High-speed tracking with kernelized correlation filters10.1109/TPAMI.2014.2345390 ↗
30. Evaluating multiple object tracking performance: The clear mot metrics10.1155/2008/246309 ↗
31. Zhang, K., Zhang, L., and Yang, M.H. (2012, January 7–13). Real-Time Compressive Tracking. Proceedings of the European Conference on Computer Vision, Florence, Italy.10.1007/978-3-642-33712-3_62 ↗