Reinforcement-Learning-Based Tracking Control with Fixed-Time Prescribed Performance for Reusable Launch Vehicle under Input Constraints
Source abstract
Abstract
This paper proposes a novel reinforcement learning (RL)-based tracking control scheme with fixed-time prescribed performance for a reusable launch vehicle subject to parametric uncertainties, external disturbances, and input constraints. First, a fixed-time prescribed performance function is employed to restrain attitude tracking errors, and an equivalent unconstrained system is derived via an error transformation technique. Then, a hyperbolic tangent function is incorporated into the optimal performance index of the unconstrained system to tackle the input constraints. Subsequently, an actor-critic RL framework with super-twisting-like sliding mode control is constructed to establish a practical solution for the optimal control problem. Benefiting from the proposed scheme, the robustness of the RL-based controller against unknown dynamics is enhanced, and the control performance can be qualitatively prearranged by users. Theoretical analysis shows that the attitude tracking errors converge to a preset region within a preassigned fixed time, and the weight estimation errors of the actor-critic networks are uniformly ultimately bounded. Finally, comparative numerical simulation results are provided to illustrate the effectiveness and improved performance of the proposed control scheme.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Adaptive Dynamic Programming Control · Adaptive Control of Nonlinear Systems · Advanced Control Systems Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Astronautics, Harbin Institute of Technology, Harbin 150001, China
Beijing Institute of Space Launch Technology, China Academy of Launch Vehicle Technology, Beijing 100076, China
Funding
SAST Foundation
References (33)
Show source-provided references
1. Launch vehicle attitude control using sliding mode control and observation techniques10.1016/j.jfranklin.2011.07.020 ↗
2. Tian, B.L., Li, Z.Y., Zhao, X.P., and Zong, Q. (2022). Adaptive Multivariable Reentry Attitude Control of RLV With Prescribed Performance. IEEE Trans. Syst. Man Cybern. Syst., 1–5.10.1109/TSMC.2022.3145508 ↗
3. Guidance command generation and nonlinear dynamic inversion control for reusable launch vehicles10.1016/j.actaastro.2020.04.002 ↗
4. Robust adaptive neural control of nonminimum phase hypersonic vehicle model10.1109/TSMC.2019.2894916 ↗
5. Fixed-time extended state observer based non-singular fast terminal sliding mode control for a VTVL reusable launch vehicle10.1016/j.ast.2018.08.028 ↗
6. Ju, X.Z., Wei, C.Z., Xu, H.C., and Wang, F. Fractional-order sliding mode control with a predefined-time observer for VTVL reusable launch vehicles under actuator faults and saturation constraints. ISA Trans., 2022. in press.10.1016/j.isatra.2022.02.003 ↗
7. Adaptive control of hypersonic vehicles with unknown dynamics based on dual network architecture10.1016/j.actaastro.2021.12.043 ↗
8. Xu, B., Shou, Y.X., Shi, Z.K., and Yan, T. (2022). Predefined-Time Hierarchical Coordinated Neural Control for Hypersonic Reentry Vehicle. IEEE Trans. Neural Netw. Learn. Syst.10.1109/TNNLS.2022.3151198 ↗
9. Werbos, P. (1992). Approximate dynamic programming for realtime control and neural modelling. Handbook of Intelligent Control: Neural, Fuzzy and Adaptive Approaches, Van Nostrand Reinhold.
10. Online actor–critic algorithm to solve the continuous-time infinite horizon optimal control problem10.1016/j.automatica.2010.02.018 ↗
11. A three-network architecture for on-line learning and optimization based on adaptive dynamic programming10.1016/j.neucom.2011.05.031 ↗
12. Learning-based Sliding Mode Control for Underactuated Deployment of Tethered Space Robot with Limited Input10.1109/TAES.2021.3126569 ↗
13. Reinforcement learning-based optimal tracking control of an unknown unmanned surface vehicle10.1109/TNNLS.2020.3009214 ↗
14. Adaptive actor–critic design-based integral sliding-mode control for partially unknown nonlinear systems with input disturbances10.1109/TNNLS.2015.2472974 ↗
15. Precise linear-motor synchronization control via cross-coupled second-order discrete-time fractional-order sliding mode
16. Finite-horizon H∞ tracking control for unknown nonlinear systems with saturating actuators10.1109/TNNLS.2017.2669099 ↗
17. Reinforcement learning-based finite-time tracking control of an unknown unmanned surface vehicle with input constraints10.1016/j.neucom.2021.04.133 ↗
18. Robust adaptive control of feedback linearizable MIMO nonlinear systems with prescribed performance10.1109/TAC.2008.929402 ↗
19. Fixed-time prescribed performance adaptive trajectory tracking control for a QUAV
20. Guaranteeing prescribed performance for air-breathing hypersonic vehicles via an adaptive non-affine tracking controller10.1016/j.actaastro.2018.06.041 ↗
21. Data-driven performance-prescribed reinforcement learning control of an unmanned surface vehicle10.1109/TNNLS.2021.3056444 ↗
22. Adaptive finite-time prescribed performance attitude tracking control for reusable launch vehicle during reentry phase: An event-triggered case10.1016/j.asr.2022.02.049 ↗
23. A policy iteration approach to online optimal control of continuous-time constrained-input systems10.1016/j.isatra.2013.04.004 ↗
24. Backstepping control with fixed-time prescribed performance for fixed wing UAV under model uncertainties and external disturbances10.1080/00207179.2020.1831700 ↗
25. Barrier Lyapunov functions-based adaptive fault tolerant control for flexible hypersonic flight vehicles with full state constraints10.1109/TSMC.2018.2837378 ↗
26. Lyshevski, S.E. (1998, January 26–26). Optimal control of nonlinear continuous-time systems: Design of bounded controllers via generalized nonquadratic functionals. Proceedings of the 1998 American Control Conference, Philadelphia, PA, USA. ACC (IEEE Cat. No. 98CH36207).10.1109/ACC.1998.694659 ↗
27. Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks10.1016/0893-6080(90)90005-6 ↗
28. Model-based reinforcement learning for approximate optimal regulation10.1016/j.automatica.2015.10.039 ↗
29. A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems10.1016/j.automatica.2012.09.019 ↗
30. Strict Lyapunov functions for the super-twisting algorithm10.1109/TAC.2012.2186179 ↗
31. Accelerated Landweber iteration based control allocation for fault tolerant control of reusable launch vehicle10.1016/j.cja.2021.03.017 ↗
32. Fixed-time disturbance observer-based nearly optimal control for reusable launch vehicle with input constraints10.1016/j.isatra.2021.04.031 ↗
33. Robust adaptive backstepping control for reentry reusable launch vehicles10.1016/j.actaastro.2016.04.015 ↗