journal article·2022-06-30Open access

Multi-Sensor Fusion for Lateral Vehicle Localization in Tunnels

Xuedong Jiang, Zunmin Liu, Bilong Liu, Jiang Liu

Applied Sciences· Volume 12· Issue 13

Abstract

The satellite navigation signal in the tunnel is weak, and it is difficult to achieve accurate lateral positioning in complex conditions such as low-speed congestion by relying solely on inertial navigation or line image recognition, which is one of the problems of automatic driving at present. In this paper, a lane-level location method based on multi-sensor fusion is proposed. Using the machine vision method, detecting lane lines with the monocular camera, and fitting the lane lines to determine the driving status of the vehicle based on the lane line information. The top view of the lane line is taken by the binocular camera, and the distance of the vehicle from the lane line and the width of the lane are calculated from the pictures taken by the binocular camera. Obtaining the heading angle information of the vehicle using the gyroscope in inertial navigation and the distance information of the vehicle using the odometer. When a car changes lanes or overtakes, the new lane the vehicle is in is calculated by calculating the difference in heading angle and combining it with the lane width and odometer information so as to complete the lateral positioning of the vehicle. The simulation results show that the algorithm has high lateral positioning accuracy. The positioning accuracy is less affected by the drift of inertial elements, and the error will not accumulate.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Video Surveillance and Tracking Methods · Infrastructure Maintenance and Monitoring

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Automotive Engineering, Qingdao University of Technology, Qingdao 266520, China

Funding

the National Natural Science Foundation of China

References (26)

Show source-provided references
1. A Reliable Fusion Positioning Strategy for Land Vehicles in GPS-Denied Environments Based on Low-Cost Sensors10.1109/TIE.2016.2637306 ↗
2. Elsheikh, M., Noureldin, A., El-Sheimy, N., and Korenberg, M. (December, January 18). Performance Analysis of MEMS-based RISS/PPP Integrated Positioning for Land Vehicles. Proceedings of the 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), Victoria, BC, Canada.10.1109/VTC2020-Fall49728.2020.9348667 ↗
3. Zheng, C., Libo, C., Linbo, Y., Qin, Q., and Ruifeng, Z. (2016, January 22–23). Lane-level positioning system based on RFID and vision. Proceedings of the IET International Conference on Intelligent and Connected Vehicles (ICV 2016), Chongqing, China.10.1049/cp.2016.1172 ↗
4. An Integrated Longitudinal and Lateral Vehicle Following Control System with Radar and Vehicle-to-Vehicle Communication10.1109/TVT.2018.2890418 ↗
5. Chen, H., Taha, T.M., and Chodavarapu, V.P. (2022). Towards Improved Inertial Navigation by Reducing Errors Using Deep Learning Methodology. Appl. Sci., 12.10.3390/app12073645 ↗
6. Tang, J., Zhang, Y., and Li, A. (2021, January 23–25). Research on Location Method Based on GNSS/IMU/LIDAR Multi-source Information Fusion. Proceedings of the 2021 3rd International Conference on Intelligent Control, Measurement and Signal Processing and Intelligent Oil Field (ICMSP), Xi’an, China.
7. Song, D., Tian, G.-M., and Liu, J. (2021, January 26–28). Real-time localization measure and perception detection using multi-sensor fusion for Automated Guided Vehicles. Proceedings of the 2021 40th Chinese Control Conference (CCC), Shanghai, China.10.23919/CCC52363.2021.9550235 ↗
8. Pan, L., Ji, K., and Zhao, J. (June, January 30). Tightly-Coupled Multi-Sensor Fusion for Localization with LiDAR Feature Maps. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9561547 ↗
9. Alrousan, Q., Matta, S., and Tasky, T. (2021). Multi-Sensor Fusion in Slow Lanes for Lane Keep Assist System, SAE International. SAE Technical Paper 2021-01-0084.10.4271/2021-01-0084 ↗
10. Qian, H., An, D., and Xia, Q. (2010, January 20–23). IMM-UKF based land-vehicle navigation with low-cost GPS/INS. Proceedings of the 2010 IEEE International Conference on Information and Automation, Harbin, China.10.1109/ICINFA.2010.5512039 ↗
11. Zhu, X., Tian, W., Li, G., and Yu, J. (2017, January 23–25). Research on Localization Vehicle Based on Multiple Sensors Fusion System. Proceedings of the 2017 International Conference on Computer Network, Electronic and Automation (ICCNEA), Xi’an, China.10.1109/ICCNEA.2017.75 ↗
12. SINS/Odometer/Doppler Radar High-Precision Integrated Navigation Method for Land Vehicle10.1109/JSEN.2021.3071181 ↗
13. Serov, A., Clemens, J., and Schill, K. (2021, January 25–28). Visual-Multi-Sensor Odometry with Application in Autonomous Driving. Proceedings of the 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring), Helsinki, Finland.10.1109/VTC2021-Spring51267.2021.9448847 ↗
14. Wang, F., Duan, J.-M., and Zheng, B.-G. (2012, January 6–8). Machine vision based localization of intelligent vehicle. Proceedings of the 10th World Congress on Intelligent Control and Automation, Beijing, China.10.1109/WCICA.2012.6359358 ↗
15. Bai, X., Wu, C., Hou, Q., and Feng, D. (2021, January 21–23). Vehicle Precise Positioning Based on Integrated Navigation System in Vehicle Networking. Proceedings of the 2021 IEEE International Conference on Robotics, Automation and Artificial Intelligence (RAAI), Hong Kong, China.10.1109/RAAI52226.2021.9507900 ↗
16. Li, K., Ouyang, Z., Hu, L., Hao, D., and Kneip, L. (June, January 30). Robust SRIF-based LiDAR-IMU Localization for Autonomous Vehicles. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9561218 ↗
17. Zhang, Z., Zhao, J., Huang, C., and Li, L. (2022). Learning Visual Semantic Map-Matching for Loosely Multi-sensor Fusion Localization of Autonomous Vehicles. IEEE Trans. Intell. Veh.10.1109/TIV.2022.3173662 ↗
18. Yu, L., Jie, L., Haoru, L., and Sijia, L. (2021, January 9–11). Large-scale scene mapping and localization based on multi-sensor fusion. Proceedings of the 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China.10.1109/ICSP51882.2021.9408987 ↗
19. Chen, J., Zhang, Q., Pan, J., and Liang, J. (2021, January 22–24). A vehicle autonomous positioning technology based on terrain relative navigation. Proceedings of the 2021 China Automation Congress (CAC), Beijing, China.10.1109/CAC53003.2021.9727251 ↗
20. Liu, B., Liu, G., Wei, S., Su, G., and Wang, J. (2018, January 10–12). On Improved Algorithm of SINS/DR Integrated Navigation System. Proceedings of the 2018 IEEE CSAA Guidance, Navigation and Control Conference (CGNCC), Xiamen, China.10.1109/GNCC42960.2018.9019119 ↗
21. Zhao, Y., Yang, Z., Song, C., and Xiong, D. (2018, January 28–30). Vehicle dynamic model-based integrated navigation system for land vehicles. Proceedings of the 2018 25th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS), St. Petersburg, Russia.10.23919/ICINS.2018.8405846 ↗
22. Vigrahala, J., Ramesh, N.V.K., Devanaboyina, V.R., and Reddy, B.N.K. (2021, January 18–19). Attitude, Position and Velocity determination using Low-cost Inertial Measurement Unit for Global Navigation Satellite System Outages. Proceedings of the 2021 10th IEEE International Conference on Communication Systems and Network Technologies (CSNT), Bhopal, India.10.1109/CSNT51715.2021.9509605 ↗
23. Improving the RISS/GNSS Land-Vehicles Integrated Navigation System Using Magnetic Azimuth Updates10.1109/TITS.2019.2905871 ↗
24. Error analysis of quaternion transformations (inertial navigation)10.1109/7.85036 ↗
25. Yaping, Z., and Zhihang, S. (2020, January 28–30). Research on Binocular Forest Fire Source Location and Ranging System. Proceedings of the 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.10.1109/ICPICS50287.2020.9201975 ↗
26. A flexible new technique for camera calibration10.1109/34.888718 ↗