journal article·2026-01-31Open access

Dynamic Attitude Estimation Method Based on LSTM-Enhanced Extended Kalman Filter

Zhengnan Guo, Zhi Xiong, Ziyue Zhao, Haosen Han, Fan Wang, Shufang Jia, Zhongsheng Zhai

Applied Sciences· Volume 16· Issue 3

Abstract

Visual–inertial attitude estimation systems often suffer from accuracy degradation and instability when visual measurements are intermittently lost due to occlusion or illumination changes. To address this issue, this paper proposes an LSTM-EKF framework for dynamic attitude estimation under visual information loss. In the proposed method, an LSTM-based vision prediction network is designed to learn the temporal evolution of visual attitude measurements and to provide reliable pseudo-observations when camera data are unavailable, thereby maintaining continuous EKF updates. The algorithm is validated through turntable experiments, including long-term reciprocating rotation tests, continuous visual occlusion scanning experiments, and attitude accuracy evaluation experiments over an extended angular range. Experimental results show that the proposed LSTM-EKF effectively suppresses IMU error accumulation during visual outages and achieves lower RMSE compared with conventional EKF and AKF methods. In particular, the LSTM-EKF maintains stable estimation performance under a certain degree of visual occlusion and extends the effective attitude measurement range beyond the camera’s observable limits. These results demonstrate that the proposed method improves robustness and accuracy of visual–inertial attitude estimation in environments with intermittent visual degradation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Inertial Sensor and Navigation · Robotics and Sensor-Based Localization · Astronomical Observations and Instrumentation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering, Hubei University of Technology, Wuhan 430068, China

Hubei Key Laboratory of Modern Manufacture Quality Engineering, Wuhan 430068, China

AVIC Beijing Changcheng Institute of Metrology & Measurement, Beijing 100095, China

Funding

China-Poland Measurement and Control Technology 'Belt and Road' Joint Laboratory Open Project

References (20)

Show source-provided references
1. A high-accuracy pose measurement system for robotic automated assembly in large-scale space10.1016/j.measurement.2021.110426 ↗
2. Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination10.1109/TRO.2011.2160468 ↗
3. Sun, C., Huang, L., Wang, P., and Guo, X. (2018). Fused Pose Measurement Algorithm Based on Double IMU and Vision Relative to a Moving Platform. Chin. J. Sens. Actuators, 31.
4. Yan, K., Xiong, Z., Lao, D.B., Zhou, W.H., Zhang, L.G., Xia, Z.P., and Chen, T. (2019, January 7–9). Attitude measurement method based on 2DPSD and monocular vision. Proceedings of the Applied Optics and Photonics China (2019), Beijing, China.
5. Zhu, K., Guo, X., Jiang, C., Xue, Y., Li, Y., Han, L., and Chen, Y. (2020). MIMU/Odometer Fusion with State Constraints for Vehicle Positioning during BeiDou Signal Outage: Testing and Results. Sensors, 20.10.3390/s20082302 ↗
6. BDS PPP/INS Tight Coupling Method Based on Non-Holonomic Constraint and Zero Velocity Update10.1109/ACCESS.2020.3008849 ↗
7. Adaptive Kalman Filtering: Measurement and Process Noise Covariance Estimation Using Kalman Smoothing10.1109/ACCESS.2025.3528348 ↗
8. Fang, W., Jiang, J., Lu, S., Gong, Y., Tao, Y., Tang, Y., Yan, P., Luo, H., and Liu, J. (2020). A LSTM Algorithm Estimating Pseudo Measurements for Aiding INS during GNSS Signal Outages. Remote Sens., 12.10.3390/rs12020256 ↗
9. Tang, Y., Jiang, J., Liu, J., Yan, P., Tao, Y., and Liu, J. (2022). A GRU and AKF-Based Hybrid Algorithm for Improving INS/GNSS Navigation Accuracy during GNSS Outage. Remote Sens., 14.10.3390/rs14030752 ↗
10. A laser tracking attitude dynamic measurement method based on real-time calibration and AEKF with a multi-factor influence analysis model10.1088/1361-6501/ada4cb ↗
11. A Review on Kalman Filter Models10.1007/s11831-022-09815-7 ↗
12. Adaptive robust Kalman filtering for precise point positioning10.1088/0957-0233/25/10/105011 ↗
13. Stochastic Stability of the Discrete-Time Extended Kalman Filter10.1109/9.754809 ↗
14. Tan, T.-N., Khenchaf, A., Comblet, F., Franck, P., Champeyroux, J.-M., and Reichert, O. (2020). Robust-Extended Kalman Filter and Long Short-Term Memory Combination to Enhance the Quality of Single Point Positioning. Appl. Sci., 10.10.3390/app10124335 ↗
15. Zhao, Z., Xiong, Z., Guo, Z., Zhang, H., Li, X., Zhai, Z., and Zhou, W. (2025). Large-Space Laser Tracking Attitude Combination Measurement Using Backpropagation Algorithm Based on Neighborhood Search. Appl. Sci., 15.10.3390/app15031083 ↗
16. Application of multi-sensor fusion localization algorithm based on recurrent neural networks10.1038/s41598-025-90492-4 ↗
17. Secure State Estimation for Train-to-Train Communication Systems: A Neural Network-Aided Robust EKF Approach10.1109/TIE.2023.3347834 ↗
18. Inertial Sensor Error Compensation for Global Positioning System Signal Blocking “Extended Kalman Filter vs. Long- and Short-term Memory”
19. EPnP: An Accurate O(n) Solution to the PnP Problem10.1007/s11263-008-0152-6 ↗
20. Shi, Y., Zhang, Y., Li, Z., Yuan, S., and Zhu, S. (2023). IMU/UWB Fusion Method Using a Complementary Filter and a Kalman Filter for Hybrid Upper Limb Motion Estimation. Sensors, 23.10.3390/s23156700 ↗