Joint Concern over Battery Health and Thermal Degradation in the Cruise Control of Intelligently Connected Electric Vehicles Using a Model-Assisted DRL Approach
Source abstract
Abstract
Eco-driving aims to enhance vehicle efficiency by optimizing speed profiles and driving patterns. However, ensuring safe following distances during eco-driving can lead to excessive use of lithium-ion batteries (LIBs), causing accelerated battery wear and potential safety concerns. This study addresses this issue by proposing a novel, multi-physics-constrained cruise control strategy for intelligently connected electric vehicles (EVs) using deep reinforcement learning (DRL). Integrating a DRL framework with an electrothermal model to estimate unmeasurable states, this strategy simultaneously manages battery degradation and thermal safety while maintaining safe following distances. Results from hardware-in-the-loop simulation testing demonstrated that this approach reduced overall driving costs by 18.72%, decreased battery temperatures by 4 °C to 8 °C in high-temperature environments, and reduced state-of-health (SOH) degradation by up to 46.43%. These findings highlight the strategy’s superiority in convergence efficiency, battery thermal safety, and cost reduction compared to existing methods. This research contributes to the advancement of eco-driving practices, ensuring both vehicle efficiency and battery longevity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Battery Technologies Research · Electric and Hybrid Vehicle Technologies · Electric Vehicles and Infrastructure
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Resources and Civil Engineering, Northeastern University, Shenyang 110819, China
College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
References (31)
Show source-provided references
1. Correctional DP-Based Energy Management Strategy of Plug-In Hybrid Electric Bus for City-Bus Route10.1109/TVT.2014.2352357 ↗
2. Optimal Control of Hybrid Electric Vehicles Based on Pontryagin’s Minimum Principle10.1109/TCST.2010.2061232 ↗
3. Approximate Pontryagin’s minimum principle applied to the energy management of plug-in hybrid electric vehicles10.1016/j.apenergy.2013.11.002 ↗
4. A novel energy management for hybrid off-road vehicles without future driving cycles as a priori10.1016/j.energy.2017.05.172 ↗
5. Time-Efficient Stochastic Model Predictive Energy Management for a Plug-In Hybrid Electric Bus With an Adaptive Reference State-of-Charge Advisory10.1109/TVT.2018.2798662 ↗
6. Energy Management of Fuel Cell/Battery/Supercapacitor Hybrid Power Sources Using Model Predictive Control10.1109/TII.2014.2333873 ↗
7. Stochastic Control of Predictive Power Management for Battery/Supercapacitor Hybrid Energy Storage Systems of Electric Vehicles10.1109/TII.2017.2766095 ↗
8. Computationally Efficient Algorithm for Eco-Driving Over Long Look-Ahead Horizons10.1109/TITS.2021.3058418 ↗
9. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv.
10. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2015). Continuous control with deep reinforcement learning. arXiv.
11. Oh, J., Chockalingam, V., and Lee, H. (2016, January 19–24). Control of memory, active perception, and action in minecraft. Proceedings of the International Conference on Machine Learning, New York, NY, USA.
12. Schulman, J., Levine, S., Abbeel, P., Jordan, M., and Moritz, P. (2015, January 6–11). Trust region policy optimization. Proceedings of the International Conference on Machine Learning, Lille, France.
13. Kendall, A., Hawke, J., Janz, D., Mazur, P., Reda, D., Allen, J.-M., Lam, V.-D., Bewley, A., and Shah, A. (2019, January 20–24). Learning to drive in a day. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793742 ↗
14. Energy efficient speed planning of electric vehicles for car-following scenario using model-based reinforcement learning10.1016/j.apenergy.2021.118460 ↗
15. Hybrid deep reinforcement learning based eco-driving for low-level connected and automated vehicles along signalized corridors10.1016/j.trc.2021.102980 ↗
16. Application and evaluation of the reinforcement learning approach to eco-driving at intersections under infrastructure-to-vehicle communications10.1177/0361198118796939 ↗
17. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
18. Hao, P., Wei, Z., Bai, Z., and Barth, M.J. (2020). Developing an Adaptive Strategy for Connected Eco-Driving under Uncertain Traffic and Signal Conditions, National Center for Sustainable Transportation.
19. Deep Reinforcement Learning based Energy-efficient Decision-making for Autonomous Electric Vehicle in Dynamic Traffic Environments10.1109/TTE.2023.3290069 ↗
20. Human-guided reinforcement learning with sim-to-real transfer for autonomous navigation10.1109/TPAMI.2023.3314762 ↗
21. Lin, X., Wang, Y.Z., Bogdan, P., Chang, N., and Pedram, M. (2014, January 2–6). Reinforcement Learning Based Power Management for Hybrid Electric Vehicles. Proceedings of the 33rd IEEE/ACM International Conference on Computer-Aided Design (ICCAD), San Jose, CA, USA.10.1109/ICCAD.2014.7001326 ↗
22. Enhancing the Fuel-Economy of V2I-Assisted Autonomous Driving: A Reinforcement Learning Approach10.1109/TVT.2020.2996187 ↗
23. Ecological Adaptive Cruise Control for Vehicles With Step-Gear Transmission Based on Reinforcement Learning10.1109/TITS.2019.2947756 ↗
24. Design and Comparison of Fuel-Saving Speed Planning Algorithms for Automated Vehicles10.1109/ACCESS.2018.2805883 ↗
25. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
26. Energy management of hybrid electric bus based on deep reinforcement learning in continuous state and action space10.1016/j.enconman.2019.05.038 ↗
27. Deep reinforcement learning of energy management with continuous control strategy and traffic information for a series-parallel plug-in hybrid electric bus10.1016/j.apenergy.2019.04.021 ↗
28. Phase-Field Modeling of Solid Electrolyte Interphase (SEI) Evolution: Considering Cracking and Dissolution during Battery Cycling10.1149/08901.0101ecst ↗
29. Multi-objective tradeoff optimization of predictive adaptive cruising control for autonomous electric buses: A cyber-physical-energy system approach10.1016/j.apenergy.2021.117385 ↗
30. A lumped-parameter electro-thermal model for cylindrical batteries10.1016/j.jpowsour.2014.01.097 ↗
31. Battery Thermal- and Health-Constrained Energy Management for Hybrid Electric Bus Based on Soft Actor-Critic DRL Algorithm10.1109/TII.2020.3014599 ↗