journal article·2026-07-16Open access

Performance–Complexity Trade‐Offs in Battery Lifetime Prediction with Task‐Aware Transformers

Jingyuan Zhao, Misheng Cai, Zhenghong Wang, Yan Wang, Yuqi Li, Bo Dong, Hewu Wang, Andrew F. Burke, Simona Onori, Stephen J. Harris

Abstract

ABSTRACT Accurate battery lifetime prediction is essential for improving reliability and safety in energy storage systems. However, balancing predictive accuracy, inference latency, and energy consumption remains challenging. We introduce FAST‐BatPro, a Flash‐Attention Sparse Transformer for Battery Prognosis. This task‐aware architecture combines convolutional feature extraction with dual attention mechanisms to enable robust, efficient, and scalable prediction. The 1.869‐million‐parameter model is evaluated from both perspectives. Across four datasets comprising more than 240,000 cycles across chemistries, FAST‐BatPro demonstrates consistent performance across fast‐charging and discharging protocols, temperature variations, and chemistry‐dependent degradation behaviors. With limited early‐cycle data, it achieves high accuracy, with coefficient of determination values approaching or exceeding 0.90 in most test settings. It maintains an inference time of 0.103 s and requires 1.65 billion FLOPs per battery over the full lifecycle. Hidden‐dimension scaling identifies a compact configuration that preserves comparable accuracy while reducing inference latency, FLOPs, and energy consumption by 12.6%, 68.1%, and 12.6%, respectively. Module‐level pruning further shows that a feed‐forward‐network‐pruned lightweight variant improves accuracy while reducing inference latency, FLOPs, and energy consumption by 11.65%, 54.64%, and 11.65%, respectively, indicating that FAST‐BatPro can serve as a reference architecture for identifying task‐specific redundancy and guiding efficient AI model design for battery diagnostics and predictive maintenance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Battery Technologies Research · Advanced Battery Materials and Technologies · Machine Learning in Materials Science

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Transportation Studies University of California Davis Davis California USA

School of Automotive and Traffic Engineering Hubei University of Arts and Science Xiangyang Hubei China

Qingdao University of Technology Qingdao Shandong China

Department of Materials Science and Engineering Stanford University Stanford California USA

Department of Control Science and Engineering Changchun University of Technology Changchun Jilin China

School of Vehicle and Mobility Tsinghua University Beijing China

Department of Energy Science and Engineering Stanford University Stanford California USA

Energy Storage and Distributed Resources Division Lawrence Berkeley National Laboratory Berkeley California USA

Funding

National Key Research and Development Program of China

References (80)

Show source-provided references
1. Electric Cars and Batteries: How Will the World Produce Enough?10.1038/d41586-021-02222-1 ↗
2. Fast Charging of Energy‐dense Lithium‐ion Batteries10.1038/s41586-022-05281-0 ↗
3. Why Do Batteries Fail?10.1126/science.1253292 ↗
4. Statistical and Machine Learning‐based Durability‐testing Strategies for Energy Storage10.1016/j.joule.2023.03.008 ↗
5. Machine‐learning Techniques Used to Accurately Predict Battery Life10.1038/d41586-019-01138-1 ↗
6. Predicting the state of Charge and Health of Batteries Using Data‐driven Machine Learning10.1038/s42256-020-0156-7 ↗
7. Machine Learning Pipeline for Battery state‐of‐health Estimation10.1038/s42256-021-00312-3 ↗
8. Selecting the Appropriate Features in Battery Lifetime Predictions10.1016/j.joule.2023.07.021 ↗
9. Predicting Battery End of Life from Solar off‐grid System Field Data Using Machine Learning10.1016/j.joule.2021.11.006 ↗
10. Opportunities for Battery Aging Mode Diagnosis of Renewable Energy Storage10.1016/j.joule.2023.06.014 ↗
11. Battery Lifetime Prognostics10.1016/j.joule.2019.11.018 ↗
12. Review on Modeling of the Anode Solid Electrolyte Interphase (SEI) for Lithium‐ion Batteries10.1038/s41524-018-0064-0 ↗
13. Stabilizing Metal Battery Anodes through the Design of Solid Electrolyte Interphases10.1016/j.joule.2021.03.024 ↗
14. Lithium Plating Mechanism, Detection, and Mitigation in Lithium‐ion Batteries10.1016/j.pecs.2021.100953 ↗
15. Onboard Early Detection and Mitigation of Lithium Plating in Fast‐charging Batteries10.1038/s41467-022-33486-4 ↗
16. Layered Oxide Cathodes for Sodium‐Ion Batteries: from Air Stability, Interface Chemistry to Phase Transition10.1002/inf2.12422 ↗
17. Pillar‐beam Structures Prevent Layered Cathode Materials from Destructive Phase Transitions10.1038/s41467-020-20169-1 ↗
18. Porous Electrode Modeling and Its Applications to Li‐Ion Batteries10.1002/aenm.202201506 ↗
19. Data‐driven Identification of Lithium‐ion Batteries: a Nonlinear Equivalent Circuit Model with Diffusion Dynamics10.1016/j.apenergy.2022.119336 ↗
20. A Comprehensive Model for Lithium‐ion Batteries: from the Physical Principles to an Electrical Model10.1016/j.energy.2017.11.154 ↗
21. Characterization and Identification towards Dynamic‐based Electrical Modeling of Lithium‐ion Batteries10.1016/j.jechem.2024.01.040 ↗
22. An Empirical Model for the Design of Batteries with High Energy Density10.1021/acsenergylett.0c00211 ↗
23. Machine Learning for Continuous Innovation in Battery Technologies10.1038/s41578-020-0216-y ↗
24. Data‐driven Health Estimation and Lifetime Prediction of Lithium‐ion Batteries: a Review10.1016/j.rser.2019.109254 ↗
25. Data‐driven‐aided Strategies in Battery Lifecycle Management: Prediction, Monitoring, and Optimization10.1016/j.ensm.2023.102785 ↗
26. Data Driven Battery Modeling and Management Method with Aging Phenomenon Considered10.1016/j.apenergy.2020.115340 ↗
27. Developing an Online Data‐driven Approach for Prognostics and Health Management of Lithium‐ion Batteries10.1016/j.apenergy.2021.118348 ↗
28. Fuzzy Entropy‐based state of Health Estimation for Li‐ion Batteries10.1109/JESTPE.2020.3047004 ↗
29. Voltage Profile Reconstruction and state of Health Estimation for Lithium‐ion Batteries under Dynamic Working Conditions10.1016/j.energy.2023.128971 ↗
30. Lithium‐ion Battery state of Health Estimation Based on Multi‐source Health Indicators Extraction and Sparse Bayesian Learning10.1016/j.energy.2023.128445 ↗
31. Accurate state of Health Estimation for Lithium‐ion Batteries under Random Charging Scenarios10.1016/j.energy.2023.128092 ↗
32. Offline and Online Blended Machine Learning for Lithium‐ion Battery Health state Estimation10.1109/TTE.2021.3129479 ↗
33. Data‐driven Prediction of Battery Cycle Life before Capacity Degradation10.1038/s41560-019-0356-8 ↗
34. Closed‐loop Optimization of Fast‐charging Protocols for Batteries with Machine Learning10.1038/s41586-020-1994-5 ↗
35. Probabilistic Remaining Useful Life Prediction without Lifetime Labels: a Bayesian Deep Learning and Stochastic Process Fusion Method10.1016/j.ress.2024.110313 ↗
36. Probabilistic Analysis for Remaining Useful Life Prediction and Reliability Assessment10.1109/TR.2020.3032157 ↗
37. Probabilistic state of Health and Remaining Useful Life Prediction for Li‐ion Batteries10.1109/TIA.2022.3210081 ↗
38. An Integrated Probabilistic Approach to Lithium‐ion Battery Remaining Useful Life Estimation
39. An Enhanced Particle Filter Technology for Battery System state Estimation and RUL Prediction10.1016/j.measurement.2022.110817 ↗
40. Early Prediction of Battery Degradation in Grid‐scale Battery Energy Storage System Using Extreme Gradient Boosting Algorithm10.1016/j.rineng.2023.101709 ↗
41. A Novel Feature Adaptive Meta‐model for Efficient Remaining Useful Life Prediction of Lithium‐ion Batteries10.1016/j.est.2025.115715 ↗
42. Parallel‐branch Enhanced ShuffleNet with Dual‐physics Constraints for Lithium‐ion Battery RUL Prediction10.1016/j.est.2025.116210 ↗
43. A lotus‐optimized Radial Basis Function Framework for Explainable and Energy‐efficient Battery Health Prediction in Electric Vehicles10.1016/j.energy.2026.140419 ↗
44. Resource‐efficient Artificial Intelligence for Battery Capacity Estimation Using Convolutional FlashAttention Fusion Networks10.1016/j.etran.2024.100383 ↗
45. Enhancing Degradation Trend Prediction of Lithium‐ion Battery Capacity in Complex Aging Scenarios: a Bayesian‐optimized Hybrid Architecture Combining Local and Global Feature Learning10.1007/s44443-025-00428-1 ↗
46. Remaining Useful Life with Self‐attention Assisted Physics‐informed Neural Network10.1016/j.aei.2023.102195 ↗
47. DLformer: a Dynamic Length Transformer‐based Network for Efficient Feature Representation in Remaining Useful Life Prediction10.1109/TNNLS.2023.3257038 ↗
48. The Challenge and Opportunity of Battery Lifetime Prediction from Field Data10.1016/j.joule.2021.06.005 ↗
49. Deep Learning10.1038/nature14539 ↗
50. Deep Neural Network Battery Charging Curve Prediction Using 30 Points Collected in 10 Min10.1016/j.joule.2021.05.012 ↗
51. Multi‐modal Framework for Battery state of Health Evaluation Using Open‐source Electric Vehicle Data10.1038/s41467-025-56485-7 ↗
52. Deep Learning to Estimate Lithium‐ion Battery state of Health without Additional Degradation Experiments10.1038/s41467-023-38458-w ↗
53. Battery Lifetime Prediction across Diverse Ageing Conditions with Inter‐cell Deep Learning10.1038/s42256-024-00972-x ↗
54. Deep Learning Powered Rapid Lifetime Classification of Lithium‐ion Batteries10.1016/j.etran.2023.100286 ↗
55. A Deep Attention‐assisted and Memory‐augmented Temporal Convolutional Network Based Model for Rapid Lithium‐ion Battery Remaining Useful Life Predictions with Limited Data10.1016/j.est.2023.106903 ↗
56. c
57. Adaptive Self‐attention LSTM for RUL Prediction of Lithium‐ion Batteries10.1016/j.ins.2023.01.100 ↗
58. Enhancing Lithium‐ion Battery Lifespan Early Prediction Using a Multi‐branch Vision Transformer Model10.1016/j.energy.2024.131816 ↗
59. Multivariate Prognosis of Battery Advanced state of Health via Transformers10.1016/j.xcrp.2024.101928 ↗
60. Specialized Convolutional Transformer Networks for Estimating Battery Health via Transfer Learning10.1016/j.ensm.2024.103668 ↗
61. Research on the Remaining Useful Life Prediction Method for Lithium‐ion Batteries by Fusion of Feature Engineering and Deep Learning10.1016/j.apenergy.2023.122325 ↗
62. Battery Fault Diagnosis and Failure Prognosis for Electric Vehicles Using Spatio‐temporal Transformer Networks10.1016/j.apenergy.2023.121949 ↗
63. STTEWS: a Sequential‐transformer Thermal Early Warning System for Lithium‐ion Battery Safety10.1016/j.apenergy.2022.119965 ↗
64. Real‐time Personalized Health Status Prediction of Lithium‐ion Batteries Using Deep Transfer Learning10.1039/D2EE01676A ↗
65. Data‐driven Capacity Estimation of Commercial Lithium‐ion Batteries from Voltage Relaxation10.1038/s41467-022-29837-w ↗
66. Degradation of Commercial Lithium‐ion Cells as a Function of Chemistry and Cycling Conditions10.1149/1945-7111/abae37 ↗
67. Pruning Algorithms‐a Survey10.1109/72.248452 ↗
68. Bayesian Learning for Rapid Prediction of Lithium‐ion Battery‐cycling Protocols10.1016/j.joule.2021.10.010 ↗
69. Attention Is All You Need
70. Analysis of Chemical and Electrochemical Lithiation/Delithiation of a Lithium‐ion Cathode Material10.1149/1945-7111/ab6bbf ↗
71. Unveiling the Three Stages of Li Plating and Dynamic Evolution Processes in Pouch C/LiFePO4 Batteries10.1002/aenm.202400894 ↗
72. The Versatile Establishment of Charge Storage in Polymer Solid Electrolyte with Enhanced Charge Transfer for LiF‐Rich SEI Generation in Lithium Metal Batteries10.1002/anie.202320149 ↗
73. Effect of Impurity Ions in the Electrosorption Lithium Extraction Process: Generation and Restriction of “Selective Concentration Polarization”10.1021/acssuschemeng.0c04359 ↗
74. A Critical Review of the Li Insertion Mechanisms in LiFePO4 Electrodes10.1149/2.029305jes ↗
75. Rate‐Dependent Failure Behavior Regulation of LiFePO4 Cathode via Functional Interface Engineering10.1002/adfm.202421284 ↗
76. A Capacity Model Based on Charging Process for state of Health Estimation of Lithium Ion Batteries10.1016/j.apenergy.2016.05.109 ↗
77. State‐of‐Health Estimation of Lithium‐Ion Batteries Using Incremental Capacity Analysis Based on Voltage–Capacity Model10.1109/TTE.2020.2994543 ↗
78. Advancing SOC Estimation in LiFePO4 Batteries: Enhanced dQ/dV Curve and Short‐pulse Methods10.1016/j.etran.2025.100466 ↗
79. Flashattention‐2: Faster Attention with Better Parallelism and Work Partitioning
80. Informer: beyond Efficient Transformer for Long Sequence Time‐series Forecasting10.1609/aaai.v35i12.17325 ↗