Robust Positioning Scheme Based on Deep Reinforcement Learning with Context-Aware Intelligence
Source abstract
Abstract
An integration of deep learning and classical filtering techniques has been developed for achieving an accurate and robust positioning system. Despite significant technological advances, positioning systems often face fundamental challenges such as signal obstruction, multipath interference, and error drift. Although 3D map matching techniques using LiDAR sensors can mitigate these challenges, their practical implementation is limited by high costs, computational burdens, and dependency on pre-modeled environments. In response, recent research has increasingly focused on enhancing positioning systems through deep learning–based sensor fusion and adaptive filtering methods, emphasizing improvements in accuracy and operational robustness. In this paper, a seamless hierarchical context-aware intelligent positioning system (SH-CAIPS) is proposed by integrating sensor fusion, two-stage outlier mitigation gates, and deep reinforcement learning (DRL)-based noise scaling with an innovation-based adaptive Kalman filter (IAKF). As a result, the proposed positioning system can enhance robustness by adaptively adjusting measurement noise and dynamically updating the position based on the confidence score between model predictions and sensor measurements. From simulation results, it is confirmed that the positioning performances can be significantly improved based on the proposed SH-CAIPS compared with conventional positioning systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Indoor and Outdoor Localization Technologies · Robotics and Sensor-Based Localization · Inertial Sensor and Navigation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronic Convergence Engineering, Kwangwoon University, Seoul 01897, Republic of Korea
References (25)
Show source-provided references
1. Future trends in mechatronics10.11591/ijra.v10i1.pp24-31 ↗
2. Zaitceva, I., and Andrievsky, B. (2022). Methods of intelligent control in mechatronics and robotic engineering: A survey. Electronics, 11.10.3390/electronics11152443 ↗
3. Plasencia-Salgueiro, A.d.J. (2023). Deep reinforcement learning for autonomous mobile robot navigation. Artificial Intelligence for Robotics and Autonomous Systems Applications, Springer.10.1007/978-3-031-28715-2_7 ↗
4. A comprehensive review of indoor/outdoor localization solutions in IoT era: Research challenges and future perspectives10.1016/j.comnet.2022.109041 ↗
5. Industrial applications of the Kalman filter: A review10.1109/TIE.2012.2236994 ↗
6. Comparison of EKF and UKF for spacecraft localization via angle measurements10.1109/TAES.2011.5705660 ↗
7. Bar-Shalom, Y., Li, X.R., and Kirubarajan, T. (2004). Estimation with Applications to Tracking and Navigation: Theory Algorithms and Software, John Wiley & Sons.
8. Kim, K., Lee, S., Hwang, B., Kim, J., Seon, J., Kim, S., Sun, Y., and Kim, J. (2024). Enhanced 3D outdoor positioning method based on adaptive Kalman filter and kernel density estimation for 6G wireless system. Electronics, 13.10.3390/electronics13234623 ↗
9. Deep learning for inertial positioning: A survey10.1109/TITS.2024.3381161 ↗
10. Jwo, D.J., Biswal, A., and Mir, I.A. (2023). Artificial neural networks for navigation systems: A review of recent research. Appl. Sci., 13.10.3390/app13074475 ↗
11. Chen, H., Aggarwal, P., Taha, T.M., and Chodavarapu, V.P. (2018, January 23–25). Improving inertial sensor by reducing errors using deep learning methodology. Proceedings of the IEEE National Aerospace & Electronics Conference (NAECON), Dayton, OH, USA.10.1109/NAECON.2018.8556718 ↗
12. DUET: Improving inertial-based odometry via deep IMU online calibration
13. Hosseinyalamdary, S. (2018). Deep Kalman filter: Simultaneous multi-sensor integration and modelling; a GNSS/IMU case study. Sensors, 18.10.20944/preprints201803.0121.v1 ↗
14. Seamless GPS/Inertial navigation system based on self-learning square-root cubature Kalman filter10.1109/TIE.2020.2967671 ↗
15. Hwang, B., Lee, S., Kim, K., Kim, S., Seon, J., Kim, J., Kim, J., Sun, Y., and Kim, J. (2024). Context-aware integrated navigation system based on deep learning for seamless localization. Sensors, 24.10.3390/s24237678 ↗
16. Deep reinforcement learning based mobile robot navigation: A review10.26599/TST.2021.9010012 ↗
17. Learning to calibrate: Reinforcement learning for guided calibration of visual–inertial rigs10.1177/0278364919844824 ↗
18. Dynamic positioning using deep reinforcement learning10.1016/j.oceaneng.2021.109433 ↗
19. Sun, Y.G., Kim, S.H., Kim, D.I., and Kim, J.Y. (IEICE Trans. Fundam. Electron. Commun. Comput. Sci., 2025). Area-selective deep reinforcement learning scheme for wireless localization, IEICE Trans. Fundam. Electron. Commun. Comput. Sci., early publication (accepted).10.1587/transfun.2024EAL2069 ↗
20. Deep-reinforcement-learning-based autonomous establishment of local positioning systems in unknown indoor environments10.1109/JIOT.2022.3142274 ↗
21. Gao, X., Luo, H., Ning, B., Zhao, F., Bao, L., Gong, Y., Xiao, Y., and Jiang, J. (2020). RL-AKF: An Adaptive Kalman Filter Navigation Algorithm Based on Reinforcement Learning for Ground Vehicles. Remote Sens., 12.10.3390/rs12111704 ↗
22. Huang, Z., Xu, Q., Sun, M., and Zhu, X. (2025). A Kalman Filter-Based Localization Calibration Method Optimized by Reinforcement Learning and Information Matrix Fusion. Entropy, 27.10.20944/preprints202506.2533.v1 ↗
23. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].
24. Comparative analysis of A3C and PPO algorithms in reinforcement learning: A survey on general environments10.1109/ACCESS.2024.3472473 ↗
25. University of Michigan north campus long-term vision and LiDAR dataset10.1177/0278364915614638 ↗