journal article·2022-10-30Open access

Transformer-Based Hybrid Forecasting Model for Multivariate Renewable Energy

Guilherme Afonso Galindo Padilha, JeongRyun Ko, Jason J. Jung, Paulo Salgado Gomes de Mattos Neto

Applied Sciences· Volume 12· Issue 21

Abstract

In recent years, the use of renewable energy has grown significantly in electricity generation. However, the output of such facilities can be uncertain, affecting their reliability. The forecast of renewable energy production is necessary to guarantee the system’s stability. Several authors have already developed deep learning techniques and hybrid systems to make predictions as accurate as possible. However, the accurate forecasting of renewable energy still is a challenging task. This work proposes a new hybrid system for renewable energy forecasting that combines the traditional linear model (Seasonal Autoregressive Integrated Moving Average—SARIMA) with a state-of-the-art Machine Learning (ML) model, Transformer neural network, using exogenous data. The proposal, named H-Transformer, is compared with other hybrid systems and single ML models, such as Long Short Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Networks (RNN), using five data sets of wind speed and solar energy. The proposed H-Transformer attained the best result compared to all single models in all datasets and evaluation metrics. Finally, the hybrid H-Transformer obtained the best result in most cases when compared to other hybrid approaches, showing that the proposal can be a useful tool in renewable energy forecasting.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Energy Load and Power Forecasting · Solar Radiation and Photovoltaics · Grey System Theory Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Chung-Ang University, Seoul 06974, Korea

Centro de Informática, Universidade Federal de Pernambuco, Recife 50740-560, Brazil

Funding

Chung-Ang University

References (43)

Show source-provided references
1. Taalas, P., and Guterres, A. (2021). State of the Global Climate 2020, WMO. WMO-No. 1264.
2. Perera, F. (2017). Pollution from Fossil-Fuel Combustion is the Leading Environmental Threat to Global Pediatric Health and Equity: Solutions Exist. Int. J. Environ. Res. Public Health, 15.10.3390/ijerph15010016 ↗
3. Solar energy in progress and future research trends10.1016/j.pecs.2004.02.004 ↗
4. Parametric study of hybrid (wind + solar + diesel) power generating systems10.1016/S0960-1481(00)00040-9 ↗
5. Solar–wind hybrid renewable energy system: A review10.1016/j.rser.2015.12.223 ↗
6. André, T., Brown, A., Collier, U., Dent, C., Epp, B., Gibb, D., Kumar, C.H., Joubert, F., Kamara, R., and Ledanois, N. (2021). Renewables 2021 Global Status Report, c/o UN Environment Programme. REN21.
7. Zervos, A., Lins, C., and Muth, J. (2010). RE-Thinking 2050, European Renewable Energy Council.10.4324/9781849775144 ↗
8. A systematic analysis of meteorological variables for PV output power estimation10.1016/j.renene.2020.01.150 ↗
9. Review of solar irradiance forecasting methods and a proposition for small-scale insular grids10.1016/j.rser.2013.06.042 ↗
10. Machine learning methods for solar radiation forecasting: A review10.1016/j.renene.2016.12.095 ↗
11. de O. Santos, D.S., de Mattos Neto, P.S.G., de Oliveira, J.F.L., Siqueira, H.V., Barchi, T.M., Lima, A.R., Madeiro, F., Dantas, D.A.P., Converti, A., and Pereira, A.C. (2022). Solar Irradiance Forecasting Using Dynamic Ensemble Selection. Appl. Sci., 12.10.3390/app12073510 ↗
12. Wind energy potential assessment based on wind speed, its direction and power data10.1038/s41598-021-96376-7 ↗
13. Multi-aspect renewable energy forecasting10.1016/j.ins.2020.08.003 ↗
14. An adaptive hybrid system using deep learning for wind speed forecasting10.1016/j.ins.2021.09.054 ↗
15. Forecasting of photovoltaic power generation and model optimization: A review10.1016/j.rser.2017.08.017 ↗
16. A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings10.1016/j.rser.2015.04.065 ↗
17. Electricity price forecasting in the short term hybridising fundamental and econometric modelling10.1016/j.epsr.2018.10.034 ↗
18. Time series forecasting using a hybrid ARIMA and neural network model10.1016/S0925-2312(01)00702-0 ↗
19. Photovoltaic power forecasting using statistical methods: Impact of weather data10.1049/iet-smt.2013.0135 ↗
20. Assessment of forecasting techniques for solar power production with no exogenous inputs10.1016/j.solener.2012.04.004 ↗
21. Forecasting Power Output of Solar Photovoltaic System Using Wavelet Transform and Artificial Intelligence Techniques10.1016/j.procs.2012.09.080 ↗
22. Yang, X., Jiang, F., and Liu, H. (2013, January 9–11). Short-Term Solar Radiation Prediction based on SVM with Similar Data. Proceedings of the 2nd IET Renewable Power Generation Conference (RPG 2013), Beijing, China.
23. A Hybrid System Based on Dynamic Selection for Time Series Forecasting10.1109/TNNLS.2021.3051384 ↗
24. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
25. A review on the prediction of building energy consumption10.1016/j.rser.2012.02.049 ↗
26. A review of artificial intelligence based building energy use prediction: Contrasting the capabilities of single and ensemble prediction models10.1016/j.rser.2016.10.079 ↗
27. A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization10.1016/j.rser.2020.109792 ↗
28. Hyndman, R.J., and Athanasopoulos, G. (2018). Forecasting: Principles and Practice, OTexts.
29. A comparative study of autoregressive neural network hybrids10.1016/j.neunet.2005.06.003 ↗
30. Snoek, J., Larochelle, H., and Adams, R.P. (2012). Practical Bayesian Optimization of Machine Learning Algorithms. arXiv.
31. A Statistical Methodology to Estimate Soiling Losses on Photovoltaic Solar Plants10.1115/1.4050948 ↗
32. Kannal, A. (2022, October 23). Solar Power Generation Data. Available online: https://www.kaggle.com/datasets/anikannal/solar-power-generation-data.
33. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2022, October 23). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. 2015. Software. Available online: tensorflow.org.
34. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
35. Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
36. Box, G. (2008). Time Series Analysis: Forecasting and Control, Jons Wiley & Sons.10.1002/9781118619193 ↗
37. Taking the Human Out of the Loop: A Review of Bayesian Optimization10.1109/JPROC.2015.2494218 ↗
38. Another look at measures of forecast accuracy10.1016/j.ijforecast.2006.03.001 ↗
39. American Society of Heating, Refrigerating, and Air-Conditioning Engineers (2014). Ashrae Guideline 14-2014: Measurement of Energy, Demand and Water Savings, American Society of Heating, Refrigerating, and Air-Conditioning Engineers.
40. No free lunch theorems for optimization10.1109/4235.585893 ↗
41. Simeunović, J., Schubnel, B., Alet, P.J., and Carrillo, R.E. (2021). Spatio-temporal graph neural networks for multi-site PV power forecasting. arXiv.10.1109/PESGM48719.2022.9916721 ↗
42. Izidio, D.M.F., de Mattos Neto, P.S.G., Barbosa, L., de Oliveira, J.F.L., da Nóbrega Marinho, M.H., and Rissi, G.F. (2021). Evolutionary Hybrid System for Energy Consumption Forecasting for Smart Meters. Energies, 14.10.3390/en14071794 ↗
43. Rodrigues, L.J.A., de Mattos Neto, P.S.G., and Ferreira, T.A.E. (2009, January 14–19). A prime step in the time series forecasting with hybrid methods: The fitness function choice. Proceedings of the 2009 International Joint Conference on Neural Networks, Atlanta, GA, USA.10.1109/IJCNN.2009.5178928 ↗