Extending Power Electronic Converter Lifetime in Marine Hydrokinetic Turbines with Reinforcement Learning
Source abstract
Abstract
Hydrokinetic turbines (HKTs) are a promising renewable energy source due to the consistency and high energy density in river and tidal resources. One of the primary barriers to the widespread adoption of HKT technologies is a high levelized cost of energy (LCOE). Considering the marine operating environment, the operation and maintenance costs are substantial. The power electronic converter, a key element in the electrical energy conversion system, is a common point of failure in direct-drive turbine applications—leading to increased maintenance efforts. This work presents a reinforcement learning (RL) method built within a quadratic feedback torque control framework to balance energy generation with power electronic device lifetime. The effectiveness of the RL-based control scheme is compared against a static baseline controller through two year-long tidal case studies. The results showed that the proposed method reduced cumulative damage on the device by upwards of 75% but reduced energy generation by up to 25.2%. Using a custom real-time cost estimation function that considers the sale of energy and an estimate of the costs associated with operating a device at a given temperature, it was found that the RL method can increase net income by up to 45.4% depending on the energy market conditions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Wind Turbine Control Systems · Wind Energy Research and Development · Photovoltaic System Optimization Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical Engineering & Computer Science, Oregon State University, Corvallis, OR 97331, USA
Funding
US Department of Energy Advanced Research Projects Agency-Energy (ARPA-E) · US Department of Energy Water Power Technologies Office
References (45)
Show source-provided references
1. Kilcher, L., Fogarty, M., and Lawson, M. (2021). Marine Energy in the United States: An Overview of Opportunities, National Renewable Energy Laboratory. Technical Report.10.2172/1766861 ↗
2. Johnson, J.B., and Pride, D.J. (2010). River, Tidal, and Ocean Current Hydrokinetic Energy Technologies: Status and Future Opportunities in Alaska, Alaska Center for Energy and Power. Technical Report.
3. A smart multiphysics approach for wind turbines design in industry 5.0
4. Towards more cost-effective river hydrokinetic turbines10.1016/j.esd.2023.101370 ↗
5. Reliability Comparison of Wind Turbines With DFIG and PMG Drive Trains10.1109/TEC.2014.2367243 ↗
6. Ranking Subassemblies of Wind Energy Conversion Systems Concerning Their Impact on the Overall Reliability10.1109/ACCESS.2021.3070533 ↗
7. Aging Mechanisms and Accelerated Lifetime Tests for SiC MOSFETs: An Overview10.1109/JESTPE.2021.3110476 ↗
8. Research on Active Thermal Control: Actual Status and Future Trends10.1109/JESTPE.2021.3067782 ↗
9. Review of Active Thermal Control for Power Electronics: Potentials, Limitations, and Future Trends10.1109/OJPEL.2024.3376086 ↗
10. Thermal Management of IGBT Module in the Wind Power Converter Based on the ROI10.1109/TIE.2021.3108729 ↗
11. Chihaia, R.A., Vasile, I., Cîrciumaru, G., Nicolaie, S., Tudor, E., and Dumitru, C. (2020). Improving the Energy Conversion Efficiency for Hydrokinetic Turbines Using MPPT Controller. Appl. Sci., 10.10.3390/app10217560 ↗
12. Maximum power point tracking algorithms for wind power generation system: Review, comparison and analysis10.1002/ese3.1313 ↗
13. Reliability Improvement for a High-Power IGBT in Wind Energy Applications10.1109/TIE.2018.2795568 ↗
14. Junction Temperature Control for More Reliable Power Electronics10.1109/TPEL.2017.2665697 ↗
15. A Health-Oriented Power Control Strategy of Direct Drive Wind Turbine10.1109/TPWRD.2021.3084216 ↗
16. A New Thermal Management Strategy of IGBT in DFIG for Economic Benefit Maximization10.1109/TII.2023.3275698 ↗
17. Implications of biofouling on cross-flow turbine performance10.1007/s42452-020-2286-2 ↗
18. Experimental and numerical studies of blade roughness and fouling on marine current turbine performance10.1016/j.renene.2013.12.012 ↗
19. An Overview of Artificial Intelligence Applications for Power Electronics10.1109/TPEL.2020.3024914 ↗
20. Nambiar, A., Anderlini, E., Payne, G., Forehand, D., Kiprakis, A., and Wallace, A. (September, January 27). Reinforcement Learning Based Maximum Power Point Tracking Control of Tidal Turbines. Proceedings of the European Wave and Tidal Energy Conference, Cork, Ireland.
21. Hasankhani, A., Tang, Y., VanZwieten, J., and Sultan, C. (2021, January 9–11). Comparison of Deep Reinforcement Learning and Model Predictive Control for Real-Time Depth Optimization of a Lifting Surface Controlled Ocean Current Turbine. Proceedings of the 2021 IEEE Conference on Control Technology and Applications (CCTA), San Diego, CA, USA.10.1109/CCTA48906.2021.9659089 ↗
22. Hasankhani, A., Ondes, E.B., Tang, Y., Sultan, C., and Van Zwieten, J. (2022, January 8–10). Integrated Path Planning and Tracking Control of Marine Current Turbine in Uncertain Ocean Environments. Proceedings of the 2022 American Control Conference (ACC), Atlanta, GA, USA.10.23919/ACC53348.2022.9867485 ↗
23. Hasankhani, A., Tang, Y., and VanZwieten, J. (June, January 31). Reinforcement Learning for Underwater Spatiotemporal Path Planning, with Application to an Autonomous Marine Current Turbine. Proceedings of the 2023 American Control Conference (ACC), San Diego, CA, USA.10.23919/ACC55779.2023.10155898 ↗
24. Simulation and study of maximum power point tracking for rim-driven tidal current energy power generation systems10.1016/j.egyr.2023.04.301 ↗
25. Barton, S., Brekken, T.K., and Cao, Y. (2024, January 10–12). Reinforcement Learning Control for Enhancing Marine Hydrokinetic Turbine Energy Generation. Proceedings of the 2024 American Control Conference (ACC), Toronto, ON, Canada.10.23919/ACC60939.2024.10644480 ↗
26. Chu, A., Xie, X., Hermann, C.M., Stork, W., and Roth-Stielow, J. (2023, January 15–18). Towards Predictive Lifetime-Oriented Temperature Control of Power Electronics in E-vehicles via Reinforcement Learning. Proceedings of the 2023 IEEE International Conference on Big Data (BigData), Sorrento, Italy.10.1109/BigData59044.2023.10386292 ↗
27. Chu, A., Hermann, C.M., Silz, J., Pfau, J., Barón, K.M., Anantharajaiah, N., Schmidt, P., Hotfilter, T., Xie, X., and Becker, J. (2023, January 6–8). LETSCOPE: Lifecycle Extensions Through Software-Defined Predictive Control of Power Electronics. Proceedings of the IEEE EUROCON 2023—20th International Conference on Smart Technologies, Torino, Italy.10.1109/EUROCON56442.2023.10199076 ↗
28. Sale, D., Jonkman, J., and Musial, W. (June, January 31). Development of a Hydrodynamic Optimization Tool for Stall-Regulated Hydrokinetic Turbine Rotors. Proceedings of the Volume 4: Ocean Engineering; Ocean Renewable Energy; Ocean Space Utilization, Parts A and B, Honolulu, HI, USA.
29. Mohan, N., and Raju, S. (2020). Analysis and Control of Electric Drives: Simulations and Laboratory Implementation, Wiley.10.1002/9781119584575 ↗
30. Using Improved Power Electronics Modeling and Turbine Control to Improve Wind Turbine Reliability10.1109/TEC.2015.2422792 ↗
31. Graovac, D.D., Pürschel, M., and Kiep, A. (2006). MOSFET Power Losses Calculation Using the Data- Sheet Parameters, Infineon Application Note.
32. Thermal Loading and Lifetime Estimation for Power Device Considering Mission Profiles in Wind Power Converter10.1109/TPEL.2014.2312335 ↗
33. Overview of Real-Time Lifetime Prediction and Extension for SiC Power Converters10.1109/TPEL.2019.2962503 ↗
34. Multi-physics and Multi-timescale Modeling of Hydrokinetic Turbine Energy Conversion System10.1109/JESTPE.2024.3450284 ↗
35. Cumulative Damage in Fatigue10.1115/1.4009458 ↗
36. The MathWorks Inc. (2024, September 15). Rainflow. Available online: https://www.mathworks.com/help/signal/ref/rainflow.html.
37. Sutton, R.S., and Barto, A. (2020). Reinforcement Learning: An Introduction, The MIT Press. [2nd ed.]. Adaptive Computation and Machine Learning.
38. Reza Amini, M., Jiang, B., Liao, Y., Naik, K., Martins, J.R., and Sun, J. (June, January 31). Control Co-design of a Hydrokinetic Turbine: A Comparative Study of Open-loop Optimal Control and Feedback Control. Proceedings of the 2023 American Control Conference (ACC), San Diego, CA, USA.10.23919/ACC55779.2023.10156550 ↗
39. How catastrophic can catastrophic forgetting be in linear regression?
40. A Practical Guide to Multi-Objective Reinforcement Learning and Planning10.1007/s10458-022-09552-y ↗
41. Calculating Reliability Using FIT & MTTF: Arrhenius HTOL Model
42. Power and thrust measurements of marine current turbines under various hydrodynamic flow conditions in a cavitation tunnel and a towing tank10.1016/j.renene.2006.01.012 ↗
43. Automotive Electronics Council (2024, September 03). Failure Mechanism Based Stress Test Qualification for Discrete Semiconductors in Automotive Applications. Available online: http://www.aecouncil.com/AECDocuments.html.
44. U.S. Geological Survey (2024, October 31). Sacramento River at Rio Vista CA—11455420, Available online: https://waterdata.usgs.gov/monitoring-location/11455420/#parameterCode=72255&period=P7D&showMedian=false.
45. (2024, October 31). GridStatus.io. Available online: https://www.gridstatus.io/live.