Learning-Based Model Predictive Control for Legged Robots with Battery–Supercapacitor Hybrid Energy Storage System
Source abstract
Abstract
Electrically driven legged robots have become popular in recent years. However, the development of reliable energy supply systems and effective energy management strategies for legged robots with dramatically varying power requirements still needs to be explored. This article proposes a learning-based model predictive control (MPC) energy management strategy for legged robots with battery–supercapacitor hybrid energy storage systems containing a power prediction unit and an MPC with learning-based adaptive weights. Firstly, the mathematical model of the legged robot is established, and a dual-layer long short-term memory network is constructed to predict the load power demand, providing the model and measurable disturbance for the MPC. Secondly, a multi-objective optimization objective function is established for the MPC-based energy management strategy. Three normalized terms, battery capacity loss, battery power fluctuation, and supercapacitor state-of-charge regulation, are balanced in the objective function. Finally, a deep learning algorithm is proposed to adaptively adjust the three weighting factors to meet the diverse operation conditions. Hardware-in-the-loop experimental implementations demonstrate that the proposed method can improve the kinematic performance of the legged robot by maintaining the supercapacitor state of charge at a relatively high level and reducing the battery capacity loss by 12.7% compared with the conventional MPC method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Electric and Hybrid Vehicle Technologies · Advanced Battery Technologies Research · Electric Vehicles and Infrastructure
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Automation, Central South University, Changsha 410083, China
School of Computer Science and Engineering, Central South University, Changsha 410075, China
School of Electronic Information, Central South University, Changsha 410075, China
References (38)
Show source-provided references
1. Learning robust perceptive locomotion for quadrupedal robots in the wild10.1126/scirobotics.abk2822 ↗
2. Katz, B., Di Carlo, J., and Kim, S. (2019, January 20–24). Mini cheetah: A platform for pushing the limits of dynamic quadruped control. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793865 ↗
3. Development of quadruped walking robots: A review10.1016/j.asej.2020.11.005 ↗
4. A literature review on the optimization of legged robots10.1177/1077546311403180 ↗
5. Online coverage of planar environments by a battery powered autonomous mobile robot10.1109/TASE.2016.2515165 ↗
6. Fu, Z., Kumar, A., Malik, J., and Pathak, D. (2021). Minimizing energy consumption leads to the emergence of gaits in legged robots. arXiv.
7. Nonlinear recurrent neural network predictive control for energy distribution of a fuel cell powered robot
8. Optimization of sizing and battery cycle life in battery/ultracapacitor hybrid energy storage systems for electric vehicle applications10.1109/TII.2014.2334233 ↗
9. Optimal charging of supercapacitors with user-specified charging time10.1016/j.est.2023.107609 ↗
10. Ultracapacitor-based auxiliary energy system for an electric vehicle: Implementation and evaluation10.1109/TIE.2007.894713 ↗
11. Optimal sizing and sensitivity analysis of a battery-supercapacitor energy storage system for electric vehicles10.1016/j.energy.2021.119851 ↗
12. Hybrid energy storage system for microgrids applications: A review10.1016/j.est.2018.12.017 ↗
13. A multi-objective optimization model of hybrid energy storage system for non-grid-connected wind power: A case study in China10.1016/j.energy.2018.08.152 ↗
14. Energy management for hybrid energy storage system in electric vehicle: A cyber-physical system perspective10.1016/j.energy.2021.120890 ↗
15. A review of key issues for control and management in battery and ultra-capacitor hybrid energy storage systems10.1016/j.etran.2020.100064 ↗
16. An adaptive fuzzy logic-based energy management strategy on battery/ultracapacitor hybrid electric vehicles10.1109/TTE.2016.2552721 ↗
17. Optimization for a hybrid energy storage system in electric vehicles using dynamic programing approach10.1016/j.apenergy.2014.11.020 ↗
18. Deep reinforcement learning-based multi-objective control of hybrid power system combined with road recognition under time-varying environment10.1016/j.energy.2021.122123 ↗
19. Energy management based on reinforcement learning with double deep Q-learning for a hybrid electric tracked vehicle10.1016/j.apenergy.2019.113708 ↗
20. Imitation reinforcement learning energy management for electric vehicles with hybrid energy storage system10.1016/j.apenergy.2024.124832 ↗
21. Battery and ultracapacitor in-the-loop approach to validate a real-time power management method for an all-climate electric vehicle10.1016/j.apenergy.2018.02.128 ↗
22. Correctional DP-based energy management strategy of plug-in hybrid electric bus for city-bus route10.1109/TVT.2014.2352357 ↗
23. Integrated battery thermal and energy management for electric vehicles with hybrid energy storage system: A hierarchical approach10.1016/j.enconman.2024.118853 ↗
24. Spatial–temporal data-driven full driving cycle prediction for optimal energy management of battery/supercapacitor electric vehicles10.1016/j.enconman.2022.116619 ↗
25. A dynamic programming-optimized two-layer adaptive energy management strategy for electric vehicles considering driving pattern recognition10.1016/j.est.2023.107924 ↗
26. Simultaneous identification and control for hybrid energy storage system using model predictive control and active signal injection10.1109/TIE.2019.2952825 ↗
27. Hybrid electric vehicles: A review of energy management strategies based on model predictive control10.1016/j.est.2022.106112 ↗
28. Grey Markov prediction-based hierarchical model predictive control energy management for fuel cell/battery hybrid unmanned aerial vehicles10.1016/j.energy.2022.125405 ↗
29. An energy management strategy based on stochastic model predictive control for plug-in hybrid electric buses10.1016/j.apenergy.2016.12.112 ↗
30. Energy management strategy for power-split plug-in hybrid electric vehicle based on MPC and double Q-learning10.1016/j.energy.2022.123182 ↗
31. ECMS-MPC energy management strategy for plug-in hybrid electric buses considering motor temperature rise effect10.1109/TTE.2022.3195945 ↗
32. A novel hierarchical predictive energy management strategy for plug-in hybrid electric bus combined with deep deterministic policy gradient10.1016/j.est.2022.104787 ↗
33. Velocity prediction and profile optimization based real-time energy management strategy for Plug-in hybrid electric buses10.1016/j.apenergy.2020.116001 ↗
34. Real-time predictive energy management of plug-in hybrid electric vehicles for coordination of fuel economy and battery degradation10.1016/j.energy.2020.119070 ↗
35. An integrated predictive energy management for light-duty range-extended plug-in fuel cell electric vehicle10.1016/j.jpowsour.2020.227780 ↗
36. Predictive vehicle-following power management for plug-in hybrid electric vehicles10.1016/j.energy.2018.10.129 ↗
37. Remaining useful life prediction and state of health diagnosis for lithium-ion batteries using particle filter and support vector regression10.1109/TIE.2017.2782224 ↗
38. Development of an empirical aging model for Li-ion batteries and application to assess the impact of Vehicle-to-Grid strategies on battery lifetime10.1016/j.apenergy.2016.03.119 ↗