Front–Rear Camera Switching Strategy for Indoor Localization in Automated Valet Parking Systems with Extended Kalman Filter and Fiducial Markers
Source abstract
Abstract
Automated Valet Parking (AVP) systems require high-precision positioning, especially in indoor environments where Global Positioning System (GPS) is unavailable. Existing methods, which use markers installed on parking lot walls or ceilings, often encounter difficulties due to marker detection failures caused by complex parking behaviors, such as infrastructure constraints or perpendicular parking. This study proposes an optimized indoor positioning system for AVP using fiducial markers recognized by front and rear vehicle cameras. To enhance accuracy and robustness, an Extended Kalman Filter (EKF) fuses vehicle kinematic data with marker pose information. Critically, to address the issue of marker occlusion by the front camera during reverse parking, a novel camera switching algorithm employing a hysteresis pattern based on vehicle position, heading, and motion direction is introduced. This ensures continuous marker visibility and stable positioning during parking maneuvers. The system’s effectiveness was validated through simulations and extensive real-vehicle experiments in a real parking space. Results demonstrate that the EKF significantly reduces positioning errors compared to kinematic prediction alone, particularly during curved driving. Furthermore, the proposed camera switching algorithm successfully overcomes the limitations of a front-only camera system, significantly improving positioning accuracy (e.g., reducing RMS error by up to 25.0% in X and 17.6% in Y during parking) and eliminating instability observed with simpler switching logic. This research contributes a cost-effective and reliable positioning solution, advancing the feasibility of AVP systems in challenging indoor environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Parking Systems Research · Robotics and Sensor-Based Localization · Indoor and Outdoor Localization Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Hyunbo Corporation, Yongin-si 17111, Republic of Korea
Department of Intelligent Mobility Engineering, Kongju National University, Cheonan-si 31080, Republic of Korea
Funding
Ministry of Trade, Industry and Energy (MOTIE)
References (29)
Show source-provided references
1. From smart parking towards autonomous valet parking: A survey, challenges and future Works10.1016/j.jnca.2020.102935 ↗
2. Timpner, J., Friedrichs, S., van Balen, J., and Wolf, L. (July, January 28). K-Stacks: High-density valet parking for automated vehicles. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Republic of Korea.10.1109/IVS.2015.7225798 ↗
3. Sturm, A.W., Kascha, M., Mejri, M.A., Henze, R., Heister, L., and Mueck, A. (2024). Automated Park and Charge: Concept and Energy Demand Calculation, SAE International. No. 2024-01-2988, SAE Technical Paper.10.4271/2024-01-2988 ↗
4. (2023). Intelligent Transport Systems-Automated Valet Parking Systems, Part 1, Annex C (Standard No. ISO 23374-1).
5. Bian, X., Chen, W., Ran, D., and Liang, Z. (2023). FiMa-reader: A cost-effective fiducial marker reader system for autonomous mobile robot docking in manufacturing environments. Appl. Sci., 13.10.3390/app132413079 ↗
6. Mofis slam: A multi-object semantic slam system with front-view, inertial, and surround-view sensors for indoor parking10.1109/TCSVT.2021.3135041 ↗
7. Keyframe-based visual–inertial odometry using nonlinear optimization10.1177/0278364914554813 ↗
8. Zhang, J., and Singh, S. (2014). LOAM: Lidar odometry and mapping in real-time. Robot. Sci. Syst., 3–8.10.15607/RSS.2014.X.007 ↗
9. 3D LIDAR map compression for efficient localization on resource constrained vehicles10.1109/TITS.2019.2961120 ↗
10. Zhu, Y., An, H., Wang, H., Xu, R., Wu, M., and Lu, K. (2024). RC-SLAM: Road constrained stereo visual SLAM system based on graph optimization. Sensors, 24.10.3390/s24020536 ↗
11. Engel, J., Schöps, T., and Cremers, D. (2014, January 6–12). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10605-2_54 ↗
12. ORB-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras10.1109/TRO.2017.2705103 ↗
13. Song, J., Jo, H., Jin, Y., and Lee, S.J. (2024). Uncertainty-aware depth network for visual inertial odometry of mobile robots. Sensors, 24.10.3390/s24206665 ↗
14. LVIO-fusion: Tightly-coupled LiDAR-visual-inertial odometry and mapping in degenerate environments10.1109/LRA.2024.3371383 ↗
15. A practical and economical ultra-wideband base station placement approach for indoor autonomous driving systems10.1155/2022/3815306 ↗
16. Qin, T., Chen, T., Chen, Y., and Su, Q. (2020, January 25–29). AVP-SLAM: Semantic visual mapping and localization for autonomous vehicles in the parking lot. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9340939 ↗
17. Vins-mono: A robust and versatile monocular visual-inertial state estimator10.1109/TRO.2018.2853729 ↗
18. Le Gentil, C., Vidal-Calleja, T., and Huang, S. (2019, January 20–24). In2lama: Inertial lidar localisation and mapping. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8794429 ↗
19. Lim, H., and Lee, Y.S. (2009, January 18–21). Real-time single camera SLAM using fiducial markers. Proceedings of the 2009 ICCAS-SICE, Fukuoka, Japan.
20. Kalman filter-based integration of DGPS and vehicle sensors for localization10.1109/TCST.2006.886439 ↗
21. Polack, P., Altché, F., d’Andréa-Novel, B., and de La Fortelle, A. (2017, January 11–14). The kinematic bicycle model: A consistent model for planning feasible trajectories for autonomous vehicles?. Proceedings of the 2017 IEEE Intelligent Vehicles Symposium (IV), Los Angeles, CA, USA.10.1109/IVS.2017.7995816 ↗
22. Julier, S.J., and Uhlmann, J.K. (1997). New extension of the Kalman filter to nonlinear systems. Proceedings Volume 3068, Signal Processing, Sensor Fusion, and Target Recognition VI, SPIE.10.1117/12.280797 ↗
23. Spong, M.W., Hutchinson, S., and Vidyasagar, M. (2006). Robot Modeling and Control, Wiley.
24. Indoor single camera SLAM using fiducial markers10.5302/J.ICROS.2009.15.4.353 ↗
25. Häne, C., Sattler, T., and Pollefeys, M. (October, January 28). Obstacle detection for self-driving cars using only monocular cameras and wheel odometry. Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.10.1109/IROS.2015.7354095 ↗
26. Grimmett, H., Buerki, M., Paz, L., Pinies, P., Furgale, P., Posner, I., and Newman, P. (2015, January 26–30). Integrating metric and semantic maps for vision-only automated parking. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7139484 ↗
27. Mourikis, A.I., and Roumeliotis, S.I. (2007, January 10–14). A multi-state constraint Kalman filter for vision-aided inertial navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.10.1109/ROBOT.2007.364024 ↗
28. Schwesinger, U., Rufli, M., Furgale, P., and Siegwart, R. (2013, January 23–26). A sampling-based partial motion planning framework for system-compliant navigation along a reference path. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), City of Gold Coast, Australia.10.1109/IVS.2013.6629500 ↗
29. Odometry 2.0: A slip-adaptive EIF-based four-wheel-odometry model for parking10.1109/TIV.2018.2886675 ↗