journal article·2024-07-08Open access

Three Novel Artificial Neural Network Architectures Based on Convolutional Neural Networks for the Spatio-Temporal Processing of Solar Forecasting Data

Llinet Benavides Cesar, Miguel-Ángel Manso-Callejo, Calimanut-Ionut Cira

Applied Sciences· Volume 14· Issue 13

Abstract

In this work, three new convolutional neural network models—spatio-temporal convolutional neural network versions 1 and 2 (ST_CNN_v1 and ST_CNN_v2), and the spatio-temporal dilated convolutional neural network (ST_Dilated_CNN)—are proposed for solar forecasting and processing global horizontal irradiance (GHI) data enriched with meteorological and astronomical variables. A comparative analysis of the proposed models with two traditional benchmark models shows that the proposed ST_Dilated_CNN model outperforms the rest in capturing long-range dependencies, achieving a mean absolute error of 31.12 W/m2, a mean squared error of 54.07 W/m2, and a forecast skill of 37.21%. The statistical analysis carried out on the test set suggested highly significant differences in performance (p-values lower than 0.001 for all metrics in all the considered scenarios), with the model with the lowest variability in performance being ST_CNN_v2. The statistical tests applied confirmed the robustness and reliability of the proposed models under different conditions. In addition, this work highlights the significant influence of astronomical variables on prediction performance. The study also highlights the intricate relationship between the proposed models and meteorological and astronomical input characteristics, providing important insights into the field of solar prediction and reaffirming the need for further research into variability factors that affect the performance of models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Solar Radiation and Photovoltaics · Energy Load and Power Forecasting · Grey System Theory Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Departamento de Ingeniería Topográfica y Cartográfica, E.T.S.I. en Topografía Geodesia y Cartografía, Universidad Politécnica de Madrid, C/Mercator 2, 28031 Madrid, Spain

References (45)

Show source-provided references
1. BOE (2024, June 16). Resolución de 30 de Diciembre de 2020, de la Dirección General de Calidad y Evaluación Ambiental, por la Que se Formula la Declaración Ambiental Estratégica del Plan Nacional Integrado de Energía y Clima 2021–2030. Madrid, 2021. Available online: https://www.boe.es/diario_boe/txt.php?id=BOE-A-2021-421.
2. The value of solar forecasts and the cost of their errors: A review10.1016/j.rser.2023.113915 ↗
3. A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality10.1016/j.rser.2022.112348 ↗
4. Cesar, L.B., e Silva, R.A., Callejo, M.M., and Cira, C.-I. (2022). Review on Spatio-Temporal Solar Forecasting Methods Driven by In Situ Measurements or Their Combination with Satellite and Numerical Weather Prediction (NWP) Estimates. Energies, 15.10.3390/en15124341 ↗
5. A review on global solar radiation prediction with machine learning models in a comprehensive perspective10.1016/j.enconman.2021.113960 ↗
6. Feng, C., and Zhang, J. (2020, January 17–20). SolarNet: A deep convolutional neural network for solar forecasting via sky images. Proceedings of the 2020 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT), Washington, DC, USA.10.1109/ISGT45199.2020.9087703 ↗
7. Le Guen, V., and Thome, N. (2020, January 14–19). A Deep Physical Model for Solar Irradiance Forecasting with Fisheye Images. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.10.1109/CVPRW50498.2020.00323 ↗
8. Spatio-Temporal Graph Neural Networks for Multi-Site PV Power Forecasting10.1109/TSTE.2021.3125200 ↗
9. Short-term solar power forecast with deep learning: Exploring optimal input and output configuration10.1016/j.solener.2019.06.041 ↗
10. Ziyabari, S., Du, L., and Biswas, S. (August, January 15). A Spatio-temporal Hybrid Deep Learning Architecture for Short-term Solar Irradiance Forecasting. Proceedings of the 2020 47th IEEE Photovoltaic Specialists Conference (PVSC), Calgary, AB, Canada.10.1109/PVSC45281.2020.9300789 ↗
11. Suresh, V., Janik, P., Rezmer, J., and Leonowicz, Z. (2020). Forecasting Solar PV Output Using Convolutional Neural Networks with a Sliding Window Algorithm. Energies, 13.10.3390/en13030723 ↗
12. Accurately forecasting solar radiation distribution at both spatial and temporal dimensions simultaneously with fully-convolutional deep neural network model10.1016/j.rser.2023.113528 ↗
13. Multibranch Attentive Gated ResNet for Short-Term Spatio-Temporal Solar Irradiance Forecasting10.1109/TIA.2021.3130852 ↗
14. Yu, F., and Koltun, V. (2015). Multi-Scale Context Aggregation by Dilated Convolutions. arXiv.
15. A Dilated Convolutional Based Model for Time Series Forecasting10.1007/s42979-021-00464-4 ↗
16. Spatiotemporal Dilated Convolution With Uncertain Matching for Video-Based Crowd Estimation10.1109/TMM.2021.3050059 ↗
17. Hybrid data augmentation and deep attention-based dilated convolutional-recurrent neural networks for speech emotion recognition10.1016/j.eswa.2023.120608 ↗
18. DDCNet: Deep dilated convolutional neural network for dense prediction10.1016/j.neucom.2022.12.024 ↗
19. Contreras, J., Ceberio, M., and Kreinovich, V. (2021). Why Dilated Convolutional Neural Networks: A Proof of Their Optimality. Entropy, 23.10.20944/preprints202104.0501.v1 ↗
20. Multi-channel fusion graph neural network for multivariate time series forecasting10.1016/j.jocs.2022.101862 ↗
21. Ultra-Short-Term Spatiotemporal Forecasting of Renewable Resources: An Attention Temporal Convolutional Network-Based Approach10.1109/TSG.2022.3175451 ↗
22. Spatial-Temporal Genetic-Based Attention Networks for Short-Term Photovoltaic Power Forecasting10.1109/ACCESS.2021.3108453 ↗
23. Rajagukguk, R.A., Ramadhan, R.A., and Lee, H.-J. (2020). A Review on Deep Learning Models for Forecasting Time Series Data of Solar Irradiance and Photovoltaic Power. Energies, 13.10.3390/en13246623 ↗
24. Advances in solar forecasting: Computer vision with deep learning10.1016/j.adapen.2023.100150 ↗
25. Cesar, L.B., Callejo, M.M., Cira, C.-I., and Alcarria, R. (2023). CyL-GHI: Global Horizontal Irradiance Dataset Containing 18 Years of Refined Data at 30-Min Granularity from 37 Stations Located in Castile and León (Spain). Data, 8.10.3390/data8040065 ↗
26. Cesar, L.B., Callejo, M.Á.M., Cira, C.-I., and Garrido, R.P.A. (2023, June 06). CyL_GHI. Zenodo, 2022. Available online: https://zenodo.org/doi/10.5281/zenodo.7404166.
27. Spatio-Temporal Resolution of Irradiance Samples in Machine Learning Approaches for Irradiance Forecasting10.1109/ACCESS.2020.2980775 ↗
28. Forecasting short-term solar irradiance based on artificial neural networks and data from neighboring meteorological stations10.1016/j.solener.2016.04.020 ↗
29. Dilated convolutional neural networks for time series forecasting
30. He, Z., Zhao, C., and Huang, Y. (2022). Multivariate Time Series Deep Spatiotemporal Forecasting with Graph Neural Network. Appl. Sci., 12.10.3390/app12115731 ↗
31. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv.
32. Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. arXiv.
33. Causal Discovery with Attention-Based Convolutional Neural Networks10.3390/make1010019 ↗
34. Chollet, F. (2023, June 06). Keras. GitHub. Available online: https://github.com/fchollet/keras.
35. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel.
36. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization, CoRR. arXiv.
37. Random Forests10.1023/A:1010933404324 ↗
38. Silva, R.A.E., da Silva, L.C.C.T., and Brito, M.C. (2018, January 24–28). Support vector regression for spatio-temporal PV forecasting PV variability The need for PV forecasting. Proceedings of the 35th EUPVSEC 2018, Brussels, Belgium.
39. Very short term forecasting of the Global Horizontal Irradiance using a spatio-temporal autoregressive model10.1016/j.renene.2014.07.012 ↗
40. Spatial-temporal forecasting of solar radiation10.1016/j.renene.2014.10.035 ↗
41. Moncada, A., Richardson, W., and Vega-Avila, R. (2018). Deep Learning to Forecast Solar Irradiance Using a Six-Month UTSA SkyImager Dataset. Energies, 11.10.3390/en11081988 ↗
42. Ghimire, S., Deo, R.C., Raj, N., and Mi, J. (2019). Deep Learning Neural Networks Trained with MODIS Satellite-Derived Predictors for Long-Term Global Solar Radiation Prediction. Energies, 12.10.3390/en12122407 ↗
43. Park, J., Moon, J., Jung, S., and Hwang, E. (2020). Multistep-Ahead Solar Radiation Forecasting Scheme Based on the Light Gradient Boosting Machine: A Case Study of Jeju Island. Remote Sens., 12.10.3390/rs12142271 ↗
44. Scikit-learn: Machine Learning in Python
45. Bootstrap Methods for Time Series10.1111/j.1751-5823.2003.tb00485.x ↗