journal article·2023-10-31Open access

Inducing Optimality in Prescribed Performance Control for Uncertain Euler–Lagrange Systems

Christos Vlachos, Ioanna Malli, Charalampos P. Bechlioulis, Kostas J. Kyriakopoulos

Applied Sciences· Volume 13· Issue 21

Abstract

The goal of this paper is to find a stabilizing and optimal control policy for a class of systems dictated by Euler–Lagrange dynamics, that also satisfies predetermined response criteria. The proposed methodology builds upon two stages. Initially, a neural network is trained online via an iterative process to capture the system dynamics, which are assumed to be unknown. Subsequently, a successive approximation algorithm is applied, employing the acquired dynamics from the previous step, to find a near-optimal control law that takes into consideration prescribed performance specifications, such as convergence speed and steady-state error. In addition, we concurrently guarantee that the system evolves exclusively within the compact set for which sufficient approximation capabilities have been acquired. Finally, we validate our claims through various simulated studies that confirm the success of both the identification process and the minimization of the cost function.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Adaptive Dynamic Programming Control · Model Reduction and Neural Networks · Adaptive Control of Nonlinear Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering, University of Patras, Rio, 26504 Patras, Greece

School of Mechanical Engineering, National Technical University of Athens, 15772 Athens, Greece

Funding

Hellenic Foundation for Research and Innovation (H.F.R.I.)

References (30)

Show source-provided references
1. Powell, W.B., and Ryzhov, I.O. (2012). Reinforcement Learning and Approximate Dynamic Programming for Feedback Control, John Wiley & Sons, Ltd.. Chapter 18.10.1002/9781118453988.ch18 ↗
2. Kirk, D. (2004). Optimal Control Theory: An Introduction, Dover Publications.
3. Reinforcement learning and adaptive dynamic programming for feedback control10.1109/MCAS.2009.933854 ↗
4. Elements of intelligence
5. Discrete-Time Nonlinear HJB Solution Using Approximate Dynamic Programming: Convergence Proof10.1109/TSMCB.2008.926614 ↗
6. Adaptive Dynamic Programming for Finite-Horizon Optimal Control of Discrete-Time Nonlinear Systems with ε-Error Bound10.1109/TNN.2010.2076370 ↗
7. Multilayer feedforward networks are universal approximators10.1016/0893-6080(89)90020-8 ↗
8. Robust Adaptive Dynamic Programming and Feedback Stabilization of Nonlinear Systems10.1109/TNNLS.2013.2294968 ↗
9. Reinforcement Learning-Based Optimal Stabilization for Unknown Nonlinear Systems Subject to Inputs with Uncertain Constraints10.1109/TNNLS.2019.2954983 ↗
10. Learning-Based Adaptive Optimal Tracking Control of Strict-Feedback Nonlinear Systems10.1109/TNNLS.2017.2761718 ↗
11. Value iteration and adaptive optimal output regulation with assured convergence rate10.1016/j.conengprac.2021.105042 ↗
12. Reinforcement Learning-Based Adaptive Optimal Exponential Tracking Control of Linear Systems with Unknown Dynamics10.1109/TAC.2019.2905215 ↗
13. Approximate optimal trajectory tracking for continuous-time nonlinear systems10.1016/j.automatica.2014.10.103 ↗
14. Na, J., Lv, Y., Wu, X., Guo, Y., and Chen, Q. (2014, January 28–30). Approximate optimal tracking control for continuous-time unknown nonlinear systems. Proceedings of the 33rd Chinese Control Conference, Nanjing, China.10.1109/ChiCC.2014.6896514 ↗
15. Adaptive Identifier-Critic-Based Optimal Tracking Control for Nonlinear Systems with Experimental Validation10.1109/TSMC.2020.3003224 ↗
16. Prescribed Performance Control of Uncertain Euler–Lagrange Systems Subject to Full-State Constraints10.1109/TNNLS.2017.2727223 ↗
17. A novel actor–critic–identifier architecture for approximate optimal control of uncertain nonlinear systems10.1016/j.automatica.2012.09.019 ↗
18. Robust Adaptive Control of Feedback Linearizable MIMO Nonlinear Systems with Prescribed Performance10.1109/TAC.2008.929402 ↗
19. Robust prescribed performance control for Euler–Lagrange systems with practically finite-time stability10.1016/j.ejcon.2019.06.010 ↗
20. Bounded-input prescribed performance control of uncertain Euler–Lagrange systems10.1049/iet-cta.2018.5480 ↗
21. Optimal Tracking Control for Uncertain Nonlinear Systems with Prescribed Performance via Critic-Only ADP10.1109/TSMC.2020.3003797 ↗
22. Fortuna, L., and Frasca, M. (2012). Optimal and Robust Control: Advanced Topics with MATLAB®, CRC Press.10.1201/b11660 ↗
23. Output Feedback Approximation-Free Prescribed Performance Tracking Control for Uncertain MIMO Nonlinear Systems10.1109/TAC.2020.2970003 ↗
24. Robust switching adaptive control of multi-input nonlinear systems10.1109/9.995038 ↗
25. Prescribed Performance Adaptive Control for Multi-Input Multi-Output Affine in the Control Nonlinear Systems10.1109/TAC.2010.2042508 ↗
26. Lewis, F.L., Vrabie, D.L., and Syrmos, V.L. (2012). Optimal Control, John Wiley & Sons, Inc.10.1002/9781118122631 ↗
27. On convergence of tracking differentiator10.1080/00207179.2011.569954 ↗
28. Harmonic-Based Optimal Motion Planning in Constrained Workspaces Using Reinforcement Learning10.1109/LRA.2021.3060711 ↗
29. Interior-point methods10.1016/S0377-0427(00)00433-7 ↗
30. Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach10.1016/j.automatica.2004.11.034 ↗