An interpretable transformer model for battery health prediction based on a multitask learning framework and cross-attention mechanism
Source abstract
Abstract
Accurate estimation of battery state of charge (SOC) and state of health (SOH) is essential for the safe control, effective scheduling, and reliable operation of electric vehicles and energy storage systems based on batteries. Although SOC and SOH are physically interdependent, they are still treated as separate estimation tasks in many existing studies, which limits prediction consistency and weakens the use of degradation information during charge-state estimation. To address this limitation, a Cross Attention-Based Multitask Transformer for Battery Health Prediction (CA-MT-BHP) is presented, meant for joint SOC and SOH valuation. The novelty of the suggested framework lies in three aspects: first, task-specific Transformer pathways are used to learn short-term electrical dynamics for SOC and long-term degradation behavior for SOH; second, a cross-attention mechanism is introduced to explicitly align SOC-specific and SOH-specific feature representations; and third, interpretability is incorporated through Local Interpretable Model-Agnostic Explanations to support transparent battery-state prediction. The model uses voltage, current, power, time, and battery temperature for SOC learning, while cumulative variables such as ampere-hour, watt-hour, chamber temperature, battery temperature, and time are used for SOH learning. The experimental results conducted on the Panasonic and NASA battery datasets show excellent predictive performance, with a testing mean absolute error (MAE) of 0.010% and testing root mean square error (RMSE) of 0.014% for SOC prediction, and a testing MAE of 0.008% and RMSE of 0.010% for SOH prediction, where R2 = 99.5% and R2 = 99.6%, respectively. The comparative and ablation analyses further demonstrate that explicit SOC–SOH feature alignment not only enhances robustness but also boosts the stability of the estimation. These outcomes validate the potential of the CA-MT-BHP framework to serve as an accurate, scalable, and interpretable methodology for more advanced battery management systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Battery Technologies Research · Electric Vehicles and Infrastructure · Green IT and Sustainability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mechatronics Engineering, K.S.Rangasamy College of Technology 1 , Tiruchengode, Namakkal,
Department of Electrical and Electronics Engineering, K.S.Rangasamy College of Technology 2 , Tiruchengode, Namakkal,
References (44)
Show source-provided references
1. Safety issues and mechanisms of lithium-ion battery cell upon mechanical abusive loading: A review10.1016/j.ensm.2019.06.036 ↗
2. Thermal state monitoring of lithium-ion batteries: Progress, challenges, and opportunities10.1016/j.pecs.2023.101120 ↗
3. Data-physics-driven estimation of battery SOC and capacity10.1016/j.energy.2024.130776 ↗
4. Lithium-ion battery SOC estimation with adaptability to changing conditions10.1109/tec.2023.3285405 ↗
5. Current trends for state-of-charge (SoC) estimation in lithium-ion battery electric vehicles10.3390/en14113284 ↗
6. Review of battery state estimation methods for electric vehicles-Part II: SOH estimation10.1016/j.est.2024.112703 ↗
7. Research on co-estimation algorithm of SOC and SOH for lithium-ion batteries in electric vehicles10.3390/electronics11020181 ↗
8. DL to estimate lithium-ion battery SOH without additional degradation experiments10.1038/s41467-023-38458-w ↗
9. Specialized deep neural networks for battery health prognostics: Opportunities and challenges10.1016/j.jechem.2023.08.047 ↗
10. Transformer-based DL models for SOC and SOH estimation of Li-ion batteries: A survey study10.3390/en17143502 ↗
11. A remote diagnosis using variable fractional order with reinforcement controller for Solar-MPPT Intelligent System10.1201/9781003202288 ↗
12. A hybrid deep neural network and self-attention mechanism for accurate estimation of battery SoC and SoH10.1109/AIMLA63829.2025.11040770 ↗
13. Joint prediction of Li-ion battery SOC and SOH based on the DRSN-CW-LSTM model10.1109/ACCESS.2023.3293726 ↗
14. A CNN-SAM-LSTM hybrid neural network for multi-state estimation of lithium-ion batteries under dynamical operating conditions10.1016/j.energy.2024.130764 ↗
15. Battery management strategies: An essential review for battery SOH monitoring techniques10.1016/j.est.2022.104427 ↗
16. A review of SOH estimation of energy storage systems: Challenges and possible solutions for futuristic applications of li-ion battery packs in electric vehicles10.1115/1.4042987 ↗
17. An on-line estimation of battery pack parameters and state-of-charge using dual filters based on pack model10.1016/j.energy.2016.08.109 ↗
18. An advanced energy consumption predictive method for artificial intelligence-based hybrid electric vehicle to improve vehicle battery efficiency for sustainable development10.1142/S0218126626500271 ↗
19. An online model-based method for state of energy estimation of lithium-ion batteries using dual filters10.1016/j.jpowsour.2015.10.011 ↗
20. A model-based state-of-charge estimation method for series-connected lithium-ion battery pack considering fast-varying cell temperature10.1016/j.energy.2019.07.063 ↗
21. A novel data-driven approach to lithium-ion battery dynamic charge state capture for new energy electric vehicles10.1002/adts.202300795 ↗
22. Data-driven discovery of lithium-ion battery SOC dynamics10.1115/1.4064026 ↗
23. Data-driven capacity estimation of commercial lithium-ion batteries from voltage relaxation10.1038/s41467-022-29837-w ↗
24. Data-driven SOC estimation of Li-ion batteries using supervised machine learning methods
25. Comparative study-based data-driven models for lithium-ion battery state-of-charge estimation10.3390/batteries10030089 ↗
26. A data-driven model framework based on DL for estimating the states of lithium-ion batteries10.1149/1945-7111/ac5bac ↗
27. DL model for SOH estimation of lithium batteries based on relaxation voltage10.1016/j.est.2023.110189 ↗
28. A recurrent neural network with long short-term memory for SOC estimation of lithium-ion batteries
29. SOC estimation of lithium-ion battery using deep convolutional stacked bidirectional LSTM
30. Hybrid 1DCNN-LSTM model for predicting lithium ion battery state of health10.19799/j.cnki.2095-4239.2021.0250 ↗
31. Combined CNN-LSTM network for state-of-charge estimation of lithium-ion batteries10.1109/access.2019.2926517 ↗
32. SOC estimation for lithium-ion battery using the LSTM-RNN with extended input and constrained output10.1016/j.energy.2022.125375 ↗
33. Improved particle swarm-untracked particle filtering for accurate battery energy state estimation with the influence of multi-parameter varying temperature constraints in Inner Mongolia power station10.1016/j.energy.2025.139492 ↗
34. An innovative square root-untraced Kalman filtering strategy with full-parameter online identification for state of power evaluation of lithium-ion batteries10.1016/j.est.2024.114555 ↗
35. Critical review of battery health state estimation with DL methods10.1016/j.jpowsour.2025.239106 ↗
36. Accelerating AI-based battery management system’s SOC and SOH on FPGA10.1155/2023/2060808 ↗
37. Prediction of SOH and remaining useful life of lithium-ion battery using graph convolutional network with dual attention mechanisms10.1016/j.ress.2022.108947 ↗
38. A comprehensive framework of synchronous SOC-SOH joint estimation for lithium-ion battery with multi-depth expert networks10.1016/j.energy.2025.138953 ↗
39. A robust and novel approach to joint SoC and SoH estimation for Li-ion batteries with experimental validation10.1007/s40435-025-01978-y ↗
40. Joint estimation of SOH and SOC of lithium battery based on feature fusion model10.1088/1361-6501/ae46c3 ↗
41. A framework of joint SOC and SOH estimation for lithium-ion batteries: Using BiLSTM as a battery model10.1016/j.jpowsour.2025.236342 ↗
42. Adaptive SOC-OCV mapping-based joint estimation of SOC and SOH in aging lithium-ion batteries using extended Kalman filtering10.1007/s43236-025-01064-8 ↗
43. P. Kollmeyer (2018). “Panasonic 18650PF Li-ion battery data,” Mendeley Data. https://data.mendeley.com/datasets/wykht8y7tg/1.
44. NASA Prognostic Center, Experiments on Li-ion batteries (2022), https://ti.arc.nasa.gov/tech/dash/groups/pcoe/prognostic-data-repository/.