journal article·2026-06-28Open access

State of Charge Estimation of Lithium-Ion Batteries Using the Window Attention Sinks Transformer

Chang Liu, Zhifeng Zheng, Guodong Xu

Batteries· Volume 12· Issue 7

Abstract

Lithium-ion batteries are the core energy storage devices for electric vehicles, and accurate state of charge (SOC) estimation is critical to ensuring their safe and reliable operation. Most existing SOC estimation methods are only suitable for constant-temperature scenarios and cannot adapt to the dynamic temperature variations in actual charging and discharging processes. To address the issue of insufficient estimation accuracy under complex conditions such as high and low temperatures, this study proposes a Window Attention Sinks Transformer (WASFormer) model. Based on the PatchTST framework, the model integrates Rotary Positional Encoding (RoPE) and Window Attention Sinks (WAS) mechanisms, and combines Huber Loss with Reversible Instance Normalization (RevIN) to establish a full-chain robustness enhancement scheme from feature preprocessing to loss optimization, which effectively suppresses the interference of noise and distribution shift on estimation stability. Comparative experiments, generalization tests, and ablation studies under various temperatures and working conditions show that the proposed model achieves higher estimation accuracy, stronger generalization ability, and robustness. It provides an effective and stable new approach for high-precision SOC estimation of lithium-ion batteries over a wide temperature range and under complex operating conditions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Battery Technologies Research · Low-power high-performance VLSI design · Advancements in Battery Materials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical and Transportation Engineering, Southwest Forestry University, Kunming 650224, China

School of Energy, Xiamen University, Xiamen 361102, China

Funding

National Natural Science Foundation of China

References (41)

Show source-provided references
1. Falcone, P.M. (2023). Sustainable Energy Policies in Developing Countries: A Review of Challenges and Opportunities. Energies, 16.10.3390/en16186682 ↗
2. Kostenko, G., and Zaporozhets, A. (2024). Transition from Electric Vehicles to Energy Storage: Review on Targeted Lithium-Ion Battery Diagnostics. Energies, 17.10.2139/ssrn.4989745 ↗
3. State-of-Health and State-of-Charge Estimation in Electric Vehicles Batteries: A Survey on Machine Learning Approaches10.1109/ACCESS.2024.3486989 ↗
4. A Combined Method for State-of-Charge Estimation for Lithium-Ion Batteries Using a Long Short-Term Memory Network and an Adaptive Cubature Kalman Filter10.1016/j.apenergy.2020.114789 ↗
5. Comparison between PI-DTC-SPWM and Fuzzy Logic for a Sensorless Asynchronous Motor Drive10.1186/s41601-021-00216-9 ↗
6. Comprehensive Power Swing Detection by Current Signal Modeling and Prediction Using the GMDH Method10.1186/s41601-021-00193-z ↗
7. Unbalanced Discharging and Aging Due to Temperature Differences among the Cells in a Lithium-Ion Battery Pack with Parallel Combination10.1016/j.jpowsour.2015.12.079 ↗
8. A Review of Lithium-Ion Battery State of Charge Estimation and Management System in Electric Vehicle Applications: Challenges and Recommendations10.1016/j.rser.2017.05.001 ↗
9. A Review of Machine Learning State-of-Charge and State-of-Health Estimation Algorithms for Lithium-Ion Batteries10.1016/j.egyr.2023.01.108 ↗
10. Influence of Change in Open Circuit Voltage on the State of Charge Estimation with an Extended Kalman Filter10.1016/j.est.2017.04.011 ↗
11. Ma, N., Yin, H., and Wang, K. (2023). Prediction of the Remaining Useful Life of Supercapacitors at Different Temperatures Based on Improved Long Short-Term Memory. Energies, 16.10.3390/en16145240 ↗
12. State of Charge Estimation of Lithium-Ion Battery Using an Improved Fractional-Order Extended Kalman Filter10.1016/j.est.2022.104007 ↗
13. Sidorov, D., Panasetsky, D., Tomin, N., Karamov, D., Zhukov, A., Muftahov, I., Dreglea, A., Liu, F., and Li, Y. (2020). Toward Zero-Emission Hybrid AC/DC Power Systems with Renewable Energy Sources and Storages: A Case Study from Lake Baikal Region. Energies, 13.10.3390/en13051226 ↗
14. Stage of Charge Estimation of Lithium-Ion Battery Packs Based on Improved Cubature Kalman Filter with Long Short-Term Memory Model10.1109/TTE.2020.3041757 ↗
15. Data-Driven ICA-Bi-LSTM-Combined Lithium Battery SOH Estimation
16. Temperature Prediction of Lithium-ion Batteries Based on Electrochemical Impedance Spectrum: A Review10.1002/er.7905 ↗
17. Data-Driven State of Charge Estimation for Lithium-Ion Battery Packs Based on Gaussian Process Regression10.1016/j.energy.2020.118000 ↗
18. State-of-Charge Estimation for Battery Management System Using Optimized Support Vector Machine for Regression10.1016/j.jpowsour.2014.07.016 ↗
19. Li, C., Chen, Z., Cui, J., Wang, Y., and Zou, F. (2014). The Lithium-Ion Battery State-of-Charge Estimation Using Random Forest Regression. Proceedings of the 2014 Prognostics and System Health Management Conference (PHM-2014 Hunan), IEEE.10.1109/PHM.2014.6988190 ↗
20. Simultaneously Estimating Two Battery States by Combining a Long Short-Term Memory Network with an Adaptive Unscented Kalman Filter10.1016/j.est.2022.104553 ↗
21. A GRU-RNN Based Momentum Optimized Algorithm for SOC Estimation10.1016/j.jpowsour.2020.228051 ↗
22. State of Charge Estimation for Lithium-Ion Batteries Based on TCN-LSTM Neural Networks10.1149/1945-7111/ac5cf2 ↗
23. State-of-Charge Estimation for Lithium-Ion Batteries Based on Attentional Sequence-to-Sequence Architecture10.1016/j.est.2023.106836 ↗
24. A Novel Convolutional Informer Network for Deterministic and Probabilistic State-of-Charge Estimation of Lithium-Ion Batteries10.1016/j.est.2022.106298 ↗
25. State-of-Charge Sequence Estimation of Lithium-Ion Battery Based on Bidirectional Long Short-Term Memory Encoder-Decoder Architecture10.1016/j.jpowsour.2019.227558 ↗
26. State of Charge Estimation Techniques for Lithium-Ion Batteries: A Review10.1002/ente.202500542 ↗
27. Recent Developments and Challenges in State-of-Charge Estimation Techniques for Electric Vehicle Batteries: A Review10.1016/j.est.2024.113623 ↗
28. Time-Series Forecasting with Deep Learning: A Survey10.1098/rsta.2020.0209 ↗
29. Kim, T., Kim, J., Tae, Y., Park, C., Choi, J.-H., and Choo, J. (2022, January 25–29). Reversible Instance Normalization for Accurate Time-Series Forecasting against Distribution Shift. Proceedings of the International Conference on Learning Representations (ICLR 2022), Virtual Event.
30. RoFormer: Enhanced Transformer with Rotary Position Embedding10.1016/j.neucom.2023.127063 ↗
31. Press, O., Smith, N.A., and Lewis, M. (2022, January 25–29). Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation. Proceedings of the International Conference on Learning Representations (ICLR 2022), Virtual Event.
32. Huang, L., Yuan, Y., Guo, J., Zhang, C., Chen, X., and Wang, J. (2019). Interlaced Sparse Self-Attention for Semantic Segmentation. arXiv.
33. Xu, Y., Nag, S., Li, D., Tian, L., and Barsoum, E. (2025). MSWA: Refining Local Attention with Multi-ScaleWindow Attention. arXiv.
34. Xiao, G., Tian, Y., Chen, B., Han, S., and Lewis, M. (2024, January 7–11). Efficient Streaming Language Models with Attention Sinks. Proceedings of the International Conference on Learning Representations (ICLR 2024), Vienna, Austria.
35. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
36. Watanabe, S. (2025). Tree-Structured Parzen Estimator: Understanding Its Algorithm Components and Their Roles for Better Empirical Performance. arXiv.
37. Liu, Y., Hu, T., Zhang, H., Wu, H., Wang, S., Ma, L., and Long, M. (2024, January 7–11). iTransformer: Inverted Transformers Are Effective for Time Series Forecasting. Proceedings of the International Conference on Learning Representations (ICLR 2024), Vienna, Austria.
38. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
39. Cho, K., van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning Phrase Representations Using RNN Encoder–Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
40. Are Transformers Effective for Time Series Forecasting?
41. Kollmeyer, P. (2018). Panasonic 18650PF Li-ion Battery Data, University of Wisconsin-Madison. Mendeley Data: Version 1.