journal article·2024-05-23Open access

Synergizing Transfer Learning and Multi-Agent Systems for Thermal Parametrization in Induction Traction Motors

Fozia Mehboob, Anas Fattouh, Smruti Sahoo

Applied Sciences· Volume 14· Issue 11

Abstract

Maintaining optimal temperatures in the critical parts of an induction traction motor is crucial for railway propulsion systems. A reduced-order lumped-parameter thermal network (LPTN) model enables computably inexpensive, accurate temperature estimation; however, it requires empirically based parameter estimation exercises. The calibration process is typically performed in labs in a controlled experimental setting, which is associated with a lot of supervised human efforts. However, the exploration of machine learning (ML) techniques in varied domains has enabled the model parameterization in the drive system outside the laboratory settings. This paper presents an innovative use of a multi-agent reinforcement learning (MARL) approach for the parametrization of an LPTN model. First, a set of reinforcement learning agents are trained to estimate the optimized thermal parameters using the simulated data in several driving cycles (DCs). The selection of a reinforcement learning agent and the level of neurons in the RL model is made based on variability of the driving cycle data. Furthermore, transfer learning is performed on a new driving cycle data collected on the measurement setup. Statistical analysis and clustering techniques are proposed for the selection of an RL agent that has been pre-trained on the historical data. It is established that by synergizing within reinforcement learning techniques, it is possible to refine and adjust the RL learning models to effectively capture the complexities of thermal dynamics. The proposed MARL framework shows its capability to accurately reflect the motor’s thermal behavior under various driving conditions. The transfer learning usage in the proposed approach could yield significant improvement in the accuracy of temperature prediction in the new driving cycles data. This approach is proposed with the aim of developing more adaptive and efficient thermal management strategies for railway propulsion systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Electric Motor Design and Analysis · Gear and Bearing Dynamics Analysis · Adhesion, Friction, and Surface Interactions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Innovation, Design and Technology (IDT), Mälardalen University (MDU), 631 05 Eskilstuna, Sweden

Alstom, 721 36 Västerås, Sweden

Funding

ECSEL Joint Undertaking (JU)

References (39)

Show source-provided references
1. Fathy Abouzeid, A., Guerrero, J.M., Endemaño, A., Muniategui, I., Ortega, D., Larrazabal, I., and Briz, F. (2020). Control strategies for induction motors in railway traction applications. Energies, 13.10.3390/en13030700 ↗
2. Optimization techniques to enhance the performance of induction motor drives: A review10.1016/j.rser.2017.05.240 ↗
3. Optimal control of traction motor drives under electrothermal constraints10.1109/JESTPE.2014.2299765 ↗
4. Combined thermal and electromagnetic analysis of permanent-magnet and induction machines to aid calculation10.1109/TIE.2008.925311 ↗
5. Ramakrishnan, R., Islam, R., Islam, M., and Sebastian, T. (2009, January 3–6). Real time estimation of parameters for controlling and monitoring permanent magnet synchronous motors. Proceedings of the 2009 IEEE International Electric Machines and Drives Conference, Miami, FL, USA.10.1109/IEMDC.2009.5075355 ↗
6. Methods of resistance estimation in permanent magnet synchronous motors for real-time thermal management10.1109/TEC.2010.2051811 ↗
7. Thermal monitoring of electric motors: State-of-the-art review and future challenges10.1109/OJIA.2021.3091870 ↗
8. A practical thermal model for the estimation of permanent magnet and stator winding temperatures10.1109/TPEL.2013.2253128 ↗
9. Analytical thermal model for fast stator winding temperature prediction10.1109/TIE.2017.2682010 ↗
10. Zhu, Y., Xiao, M., Lu, K., Wu, Z., and Tao, B. (2019). A simplified thermal model and online temperature estimation method of permanent magnet synchronous motors. Appl. Sci., 9.10.3390/app9153158 ↗
11. Guemo, G.G., Chantrenne, P., and Jac, J. (2013, January 12–15). Parameter identification of a lumped parameter thermal model for a permanent magnet synchronous machine. Proceedings of the 2013 International Electric Machines & Drives Conference, Chicago, IL, USA.
12. Huber, T., Peters, W., and Böcker, J. (2014, January 18–21). Monitoring critical temperatures in permanent magnet synchronous motors using low-order thermal models. Proceedings of the 2014 International Power Electronics Conference (IPEC-Hiroshima 2014-ECCE ASIA), Hiroshima, Japan.10.1109/IPEC.2014.6869785 ↗
13. Gedlu, E.G., Wallscheid, O., and Böcker, J. (2020, January 15–17). Permanent magnet synchronous machine temperature estimation using low-order lumped-parameter thermal network with extended iron loss model. Proceedings of the 10th International Conference on Power Electronics, Machines and Drives (PEMD 2020), Online Conference.10.1049/icp.2021.1017 ↗
14. Global identification of a low-order lumped-parameter thermal network for permanent magnet synchronous motors10.1109/TEC.2015.2473673 ↗
15. Online thermal parameter identification for permanent magnet synchronous machines10.1049/iet-epa.2020.0119 ↗
16. Data-driven permanent magnet temperature estimation in synchronous motors with supervised machine learning: A benchmark10.1109/TEC.2021.3052546 ↗
17. Machine learning for the control and monitoring of electric machine drives: Advances and trends10.1109/OJIA.2023.3284717 ↗
18. Kirchgässner, W., Wallscheid, O., and Böcker, J. (2019, January 12–14). Empirical evaluation of exponentially weighted moving averages for simple linear thermal modeling of permanent magnet synchronous machines. Proceedings of the 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE), Vancouver, BC, Canada.10.1109/ISIE.2019.8781195 ↗
19. Prediction of internal temperature in stator winding of three-phase induction motors with ann10.1002/etep.420 ↗
20. Wallscheid, O., Kirchgässner, W., and Böcker, J. (2017, January 14–19). Investigation of long short-term memory networks to temperature prediction for permanent magnet synchronous motors. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.10.1109/IJCNN.2017.7966088 ↗
21. Kirchgässner, W., Wallscheid, O., and Böcker, J. (2019, January 12–15). Deep residual convolutional and recurrent neural networks for temperature estimation in permanent magnet synchronous motors. Proceedings of the 2019 IEEE International Electric Machines & Drives Conference (IEMDC), San Diego, CA, USA.10.1109/IEMDC.2019.8785109 ↗
22. Thermal neural networks: Lumped-parameter thermal modeling with state-space machine learning10.1016/j.engappai.2022.105537 ↗
23. Neural-network-based parameter estimations of induction motors10.1109/TIE.2008.918615 ↗
24. A comprehensive review of state-of-the-art parameter estimation techniques for permanent magnet synchronous motors in wide speed range10.1109/TII.2019.2944413 ↗
25. Harashima, F., Demizu, Y., Kondo, S., and Hashimoto, H. (1989, January 1–5). Application of neutral networks to power converter control. Proceedings of the Conference Record of the IEEE Industry Applications Society Annual Meeting, San Diego, CA, USA.
26. Identification and control of induction machines using artificial neural networks10.1109/28.382123 ↗
27. On-line adaptive artificial neural network based vector control of permanent magnet synchronous motors10.1109/60.736315 ↗
28. Implementation of an artificial-neural-network-based real-time adaptive controller for an interior permanent-magnet motor drive10.1109/TIA.2002.807233 ↗
29. Deep reinforcement learning towards real-world dynamic thermal management of data centers10.1016/j.apenergy.2022.120561 ↗
30. Egan, D., Zhu, Q., and Prucka, R. (2023). A Review of Reinforcement Learning-Based Powertrain Controllers: Effects of Agent Selection for Mixed-Continuity Control and Reward Formulation. Energies, 16.10.3390/en16083450 ↗
31. Reinforcement learning-based control for the thermal management of the battery and occupant compartments of electric vehicles10.1039/D3SE01403G ↗
32. Transferring online reinforcement learning for electric motor control from simulation to real-world experiments10.1109/OJPEL.2021.3065877 ↗
33. Toward a reinforcement learning environment toolbox for intelligent electric motor control10.1109/TNNLS.2020.3029573 ↗
34. Bhattacharjee, S., Halder, S., Balamurali, A., Towhidi, M., Iyer, L.V., and Kar, N.C. (2020, January 8–9). An advanced policy gradient based vector control of PMSM for EV application. Proceedings of the 2020 10th International Electric Drives Production Conference (EDPC), Ludwigsburg, Germany.10.1109/EDPC51184.2020.9388187 ↗
35. Fattouh, A., and Sahoo, S. (2023, January 25–28). Data-driven reinforcement learning-based parametrization of a thermal model in induction traction motors. Proceedings of the 64th International Conference of Scandinavian Simulation Society, SIMS 2023, Västerås, Sweden.10.3384/ecp200040 ↗
36. Wöckinger, D., Bramerdorfer, G., Drexler, S., Vaschetto, S., Cavagnino, A., Tenconi, A., Amrhein, W., and Jeske, F. (2020, January 11–15). Measurement-based optimization of thermal networks for temperature monitoring of outer rotor PM machines. Proceedings of the 2020 IEEE Energy Conversion Congress and Exposition (ECCE), Detroit, MI, USA.10.1109/ECCE44975.2020.9236388 ↗
37. Filizadeh, S. (2013). Electric Machines and Drives: Principles, Control, Modeling, and Simulation, CRC Press.10.1201/9781315169651 ↗
38. Maroteaux, A. (2016). Study of Analytical Models for Harmonic Losses Calculations in Traction Induction Motors, KTH, School of Electrical Engineering (EES).
39. Roshandel, E., Mahmoudi, A., Kahourzade, S., Yazdani, A., and Shafiullah, G. (2021). Losses in efficiency maps of electric vehicles: An overview. Energies, 14.10.3390/en14227805 ↗