journal article·2023-02-01Open access

Dual-Encoder Transformer for Short-Term Photovoltaic Power Prediction Using Satellite Remote-Sensing Data

Haizhou Cao, Jing Yang, Xuemeng Zhao, Tiechui Yao, Jue Wang, Hui He, Yangang Wang

Applied Sciences· Volume 13· Issue 3

Abstract

The penetration of photovoltaic (PV) energy has gained a significant increase in recent years because of its sustainable and clean characteristics. However, the uncertainty of PV power affected by variable weather poses challenges to an accurate short-term prediction, which is crucial for reliable power system operation. Existing methods focus on coupling satellite images with ground measurements to extract features using deep neural networks. However, a flexible predictive framework capable of handling these two data structures is still not well developed. The spatial and temporal features are merely concatenated and passed to the following layer of a neural network, which is incapable of utilizing the correlation between them. Therefore, we propose a novel dual-encoder transformer (DualET) for short-term PV power prediction. The dual encoders contain wavelet transform and series decomposition blocks to extract informative features from image and sequence data, respectively. Moreover, we propose a cross-domain attention module to learn the correlation between the temporal features and cloud information and modify the attention modules with the spare form and Fourier transform to improve their performance. The experiments on real-world datasets, including PV station data and satellite images, show that our model achieves better results than other models for short-term PV power prediction.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Solar Radiation and Photovoltaics · Photovoltaic System Optimization Techniques · Energy Load and Power Forecasting

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Network Information Center, Chinese Academy of Sciences, Beijing 100083, China

University of Chinese Academy of Sciences, Beijing 100049, China

School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, China

Funding

National Key R&D Program of China

References (40)

Show source-provided references
1. Solar Energy: Potential and Future Prospects10.1016/j.rser.2017.09.094 ↗
2. Understanding the Multidimensional Linkages among Renewable Energy, Pollution, Economic Growth and Urbanization in Contemporary Economies: Quantitative Assessments across Different Income Countries’ Groups10.1016/j.rser.2021.110818 ↗
3. A Novel Approach for Seamless Probabilistic Photovoltaic Power Forecasting Covering Multiple Time Frames10.1109/TSG.2019.2951288 ↗
4. Probabilistic Forecast of PV Power Generation Based on Higher Order Markov Chain10.1109/TPWRS.2016.2616902 ↗
5. Letcher, T.M., and Fthenakis, V.M. (2018). A Comprehensive Guide to Solar Energy Systems, Academic Press.10.1016/B978-0-12-811479-7.00001-4 ↗
6. An ARMAX Model for Forecasting the Power Output of a Grid Connected Photovoltaic System10.1016/j.renene.2013.11.067 ↗
7. Development of Statistical Time Series Models for Solar Power Prediction10.1016/j.renene.2015.03.038 ↗
8. A Recursive Ensemble Model for Forecasting the Power Output of Photovoltaic Systems10.1016/j.solener.2019.07.061 ↗
9. Site-Specific Adjustment of a NWP-Based Photovoltaic Production Forecast10.1016/j.solener.2020.10.024 ↗
10. Short-Range Direct and Diffuse Irradiance Forecasts for Solar Energy Applications Based on Aerosol Chemical Transport and Numerical Weather Modeling10.1175/2009JAMC2090.1 ↗
11. Kato, T., Manabe, Y., Funabashi, T., Yoshiura, K., Kurimoto, M., and Suzuoki, Y. (2016, January 16–20). A Study on Several Hours Ahead Forecasting of Spatial Average Irradiance Using NWP Model and Satellite Infrared Image. Proceedings of the 2016 IEEE International Conference on Probabilistic Methods Applied to Power Systems (PMAPS), Beijing, China.10.1109/PMAPS.2016.7764096 ↗
12. Zhang, C., Du, Y., Chen, X., and Lu, D.D.C. (February, January 31). Cloud Motion Tracking System Using Low-Cost Sky Imager for PV Power Ramp-Rate Control. Proceedings of the 2018 IEEE International Conference on Industrial Electronics for Sustainable Energy Systems (IESES), Hamilton, New Zealand.10.1109/IESES.2018.8349927 ↗
13. 3D-CNN-Based Feature Extraction of Ground-Based Cloud Images for Direct Normal Irradiance Prediction10.1016/j.solener.2019.01.096 ↗
14. Recent Advances in Intra-Hour Solar Forecasting: A Review of Ground-Based Sky Image Methods10.1016/j.ijforecast.2021.11.002 ↗
15. Cloud Motion Vectors from a Network of Ground Sensors in a Solar Power Plant10.1016/j.solener.2013.05.027 ↗
16. A Hybrid Approach to Estimate the Complex Motions of Clouds in Sky Images10.1016/j.solener.2016.09.002 ↗
17. Solar Forecasting: Methods, Challenges, and Performance10.1109/MPE.2015.2461351 ↗
18. Global Horizontal Irradiance Forecast for Finland Based on Geostationary Weather Satellite Data10.1016/j.solener.2020.01.008 ↗
19. Cros, S., Liandrat, O., Sebastien, N., and Schmutz, N. (2014, January 13–18). Extracting cloud motion vectors from satellite images for solar power forecasting. Proceedings of the 2014 IEEE Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada.10.1109/IGARSS.2014.6947394 ↗
20. Kebir, N., and Maaroufi, M. (2018, January 25–26). Best-effort algorithm for predicting cloud motion impact on solar PV power systems production. Proceedings of the 2018 6th International Istanbul Smart Grids and Cities Congress and Fair (ICSG), Istanbul, Turkey.10.1109/SGCF.2018.8408937 ↗
21. Zhou, Z., Zhang, X., Zhen, Z., and Mei, S. (2020, January 23–25). Cloud Displacement Vector Calculation in Satellite Images Based on Cloud Pixel Spatial Aggregation and Edge Matching for PV Power Forecasting. Proceedings of the 2020 IEEE Sustainable Power and Energy Conference (iSPEC), Chengdu, China.10.1109/iSPEC50848.2020.9351115 ↗
22. Cai, Y., Liu, H., Hu, P., Fu, Z., Wang, Y., Zhang, D., Ma, X., and Li, S. (2021, January 22–24). Ultra-short-term Photovoltaic Power Prediction Based on Elman Neural Network and Satellite Cloud Images. Proceedings of the 2021 IEEE 5th Conference on Energy Internet and Energy System Integration (EI2), Taiyuan, China.10.1109/EI252483.2021.9713003 ↗
23. Wang, C., Lu, X., Zhen, Z., Wang, F., Xu, X., and Ren, H. (2020, January 4–6). Ultra-Short-Term Regional PV Power Forecasting Based on Fluctuation Pattern Recognition with Satellite Images. Proceedings of the 2020 IEEE 3rd Student Conference on Electrical Machines and Systems (SCEMS), Jinan, China.10.1109/SCEMS48876.2020.9352318 ↗
24. Blanc, P., Remund, J., and Vallance, L. (2017). Renewable Energy Forecasting, Elsevier.
25. Hybrid Solar Forecasting Method Using Satellite Visible Images and Modified Convolutional Neural Networks10.1109/TIA.2020.3028558 ↗
26. Agoua, X.G., Girard, R., and Kariniotakis, G. (2021). Photovoltaic Power Forecasting: Assessment of the Impact of Multiple Sources of Spatio-Temporal Data on Forecast Accuracy. Energies, 14.10.3390/en14051432 ↗
27. Intra-Hour Photovoltaic Generation Forecasting Based on Multi-Source Data and Deep Learning Methods10.1109/TSTE.2021.3123337 ↗
28. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA.
29. Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., and Funtowicz, M. (2020, January 16–20). Transformers: State-of-the-Art Natural Language Processing. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Online.10.18653/v1/2020.emnlp-demos.6 ↗
30. A Survey on Vision Transformer10.1109/TPAMI.2022.3152247 ↗
31. Spatio-Temporal Graph Neural Networks for Multi-Site PV Power Forecasting10.1109/TSTE.2021.3125200 ↗
32. Wavelet-Based Image Processing10.1080/00036810500358874 ↗
33. STL: A Seasonal-Trend Decomposition Procedure Based on Loess
34. Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting
35. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
36. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the International Conference on Machine Learning, PMLR, Lille, France.
37. Brigham, E.O. (1988). The Fast Fourier Transform and Its Applications, Prentice-Hall, Inc.
38. Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
39. ARIMA-Based Time Series Model of Stochastic Wind Power Generation10.1109/TPWRS.2009.2033277 ↗
40. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗