journal article·2025-05-23Open access

Optimal Weighting Factors Design for Model Predictive Current Controller for Enhanced Dynamic Performance of PMSM Employing Deep Reinforcement Learning

Muhammad Usama, Amine Salaje, Thomas Chevet, Nicolas Langlois

Applied Sciences· Volume 15· Issue 11

Abstract

This paper presents a novel control strategy employing a deep reinforcement learning (DRL) scheme for online selection of optimal weighting factors in cost functions of the finite control set model predictive current controller of a permanent magnet synchronous motor (PMSM). Indeed, when designing predictive controllers for PMSMs’ phase currents, competing objectives appear, such as managing current convergence and switching transitions. These objectives result in an asymmetric cost function where they have to be balanced through weighting factors in order to enhance the inverter and motor performance. Leveraging the twin delayed deep deterministic policy gradient algorithm, the optimal weighting factor selection policy is obtained for online balancing of the choice between current deviation in the dq frame and inverter commutations. For comparison, a metaheuristic-based artificial neural network is trained on static data obtained through a multi-objective genetic algorithm to predict the weights. The key performance markers, such as torque ripple, total harmonic distortion, switching frequency, steady-state, and dynamic performance, are provided through numerical simulations to verify the effectiveness of the proposed tuning scheme. The results of these simulations confirm that the proposed dynamic control scheme effectively resolves the challenges of weighting factor choice, meeting inverter performance requirements, and delivering better dynamic and steady-state performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Multilevel Inverters and Converters · Advanced DC-DC Converters · Advanced Battery Technologies Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

ESIGELEC, IRSEEM, Université de Rouen Normandie, 76000 Rouen, France

Funding

ANR and Région Normandie through the HAISCoDe · PAMAP projects

References (38)

Show source-provided references
1. Nam, K.H. (2010). AC Motor Control and Electrical Vehicle Applications, CRC Press. [1st ed.].
2. Xu, W., Ismail, M.M., and Islam, M.R. (2024). Permanent Magnet Synchronous Machines and Drives: Flux Weakening Advanced Control Techniques, CRC Press.10.1201/9781003320128 ↗
3. Bida, V.M., Samokhvalov, D.V., and Al-Mahturi, F.S. (February, January 29). PMSM vector control techniques–A survey. Proceedings of the 2018 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering, Moscow, Russia.10.1109/EIConRus.2018.8317164 ↗
4. A novel SVPWM scheme for field-oriented vector-controlled PMSM drive system fed by cascaded H-bridge inverter10.1109/TPEL.2021.3054642 ↗
5. Direct torque control based on a fast modeling method for a segmented-rotor switched reluctance motor in HEV application10.1109/JESTPE.2019.2950085 ↗
6. Yu, Z., and Long, J. (2024). Review on advanced model predictive control technologies for high-power converters and industrial drives. Electronics, 13.10.3390/electronics13244969 ↗
7. Optimal predictive voltage control of a wind driven five phase PMSG system feeding an isolated load10.1016/j.prime.2024.100697 ↗
8. Robust predictive control of three-level NPC back-to-back power converter PMSG wind turbine systems with revised predictions10.1109/TPEL.2018.2796093 ↗
9. Zhang, Y., Liu, X., Li, H., and Zhang, Z. (2023). A model independent predictive control of PMSG wind turbine systems with a new mechanism to update variables. Energies, 16.10.3390/en16093764 ↗
10. Continuous control set model predictive control for the optimal current control of permanent magnet synchronous motors10.1016/j.conengprac.2023.105590 ↗
11. Guidelines for the design of finite control set model predictive controllers10.1109/TPEL.2019.2954357 ↗
12. A fixed switching frequency scheme for finite-control-set model predictive control – Concept and algorithm10.1109/TIE.2016.2593997 ↗
13. Model predictive control with constant switching frequency for three-level T-type inverter-fed PMSM drives10.1109/TIE.2021.3114716 ↗
14. Performance enhancement of a grid connected wind turbine-based PMSG using effective predictive control algorithm10.1109/ACCESS.2025.3557194 ↗
15. Usama, M., and Kim, J. (2025). Model-free current control solution employing intelligent control for enhanced motor drive performance. Sci. Rep., 15.10.1038/s41598-024-83711-x ↗
16. Weighting factor design in model predictive control of power electronic converters: An artificial neural network approach10.1109/TIE.2018.2875660 ↗
17. Zhang, Y., Zhang, Z., Babayomi, O., and Li, Z. (2023). Weighting factor design techniques for predictive control of power electronics and motor drives. Symmetry, 15.10.3390/sym15061219 ↗
18. Cortes, P., Kouro, S., La Rocca, B., Vargas, R., Rodriguez, J., Leon, J.I., Vazquez, S., and Franquelo, L.G. (2009, January 10–13). Guidelines for weighting factors design in Model Predictive Control of power converters and drives. Proceedings of the 2009 IEEE International Conference on Industrial Technology, Churchill, Australia.10.1109/ICIT.2009.4939742 ↗
19. Latest advances of model predictive control in electrical drives—Part II: Applications and benchmarking with classical control methods10.1109/TPEL.2021.3121589 ↗
20. Dynamically weighted optimal switching vector model predictive control of power converters10.1109/TIE.2018.2829689 ↗
21. Model predictive control of a voltage-source inverter with seamless transition between islanded and grid-connected operations10.1109/TIE.2017.2696459 ↗
22. A very simple strategy for high-quality performance of AC machines using model predictive control10.1109/TPEL.2018.2812833 ↗
23. Zhang, J., Li, L., Norambuena, M., Rodriguez, J., and Dorrell, D.G. (2018, January 21–23). Sequential model predictive control of direct matrix converter without weighting factors. Proceedings of the IECON 2018-44th Annual Conference of the IEEE Industrial Electronics Society, Washington, DC, USA.10.1109/IECON.2018.8592697 ↗
24. Weighting factors optimization of model predictive torque control of induction motor using NSGA-II with TOPSIS decision making10.1109/ACCESS.2019.2958415 ↗
25. Neural-network vector controller for permanent-magnet synchronous motor drives: Simulated and hardware-validated results10.1109/TCYB.2019.2897653 ↗
26. A novel neural network vector control technique for induction motor drive10.1109/TEC.2015.2436914 ↗
27. Weighting factors optimization of predictive torque control of induction motor by multiobjective genetic algorithm10.1109/TPEL.2018.2834304 ↗
28. Zanchetta, P. (2011, January 14–15). Heuristic multi-objective optimization for cost function weights selection in finite states model predictive control. Proceedings of the 2011 Workshop on Predictive Control of Electrical Drives and Power Electronics, Munich, Germany.10.1109/PRECEDE.2011.6078690 ↗
29. Multiobjective switching state selector for finite-states model predictive control based on fuzzy decision making in a matrix converter10.1109/TIE.2012.2206343 ↗
30. Optimal cost function parameter design in predictive torque control (PTC) using artificial neural networks (ANN)10.1109/TIE.2020.3009607 ↗
31. An artificial intelligence approach for real-time tuning of weighting factors in FCS-MPC for power converters10.1109/TIE.2021.3127046 ↗
32. Fujimoto, S., Hoof, H., and Meger, D. (2018, January 10–15). Addressing function approximation error in actor-critic methods. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
33. Deb, K. (2001). Multi-Objective Optimization Using Evolutionary Algorithms, John Wiley & Sons.
34. Atkinson, K.E. (1989). An Introduction to Numerical Analysis, John Wiley & Sons.
35. Performance improvement of model-predictive current control of permanent magnet synchronous motor drives10.1109/TIA.2017.2690998 ↗
36. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.].
37. Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2019). Continuous control with deep reinforcement learning. arXiv.
38. Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018, January 10–15). Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.