Ensemble optical flow algorithms for intra-day solar irradiance forecasting with Fengyun-4A
Source abstract
Abstract
Solar nowcasting over the 0–4-h horizon is essential to the intra-day scheduling of power systems with high solar penetration. It is, now, widely acknowledged that methods leveraging the geostationary weather satellite data are the most promising options, for such data is able to offer spatio-temporal information that is absolutely vital to capturing the variability of irradiance and thus solar power. Satellite-based irradiance nowcasting takes three general steps: (1) irradiance retrieval from the top-of-the-atmosphere reflectance images, (2) time-forward advection of the irradiance field, and (3) post-processing the forecasts. Since nowcasting applications demand some irradiance retrieval techniques that are computationally light, semi-empirical algorithms such as Heliosat-2 are often favored. On the other hand, optical flow, contrasting other means of acquiring the cloud motion vectors, is commonly regarded as more competitive. On this point, this study presents a concise technical review of several fundamental optical flow algorithms and demonstrates them, with data from Fengyun-4A, which is China’s latest-generation geostationary weather satellite that has hitherto been somewhat under-utilized for solar energy meteorology. Using high-quality measurements from a research-grade radiometric station as verifications, it is found that the 0–4-h nowcasting yields 19.5%–26.7% and 42.4%–53.2% nRMSEs for global horizontal irradiance and beam normal irradiance, respectively, outperforming previous results obtained with Fengyun-4A. Furthermore, ensemble optical flow, which acts as a form of post-processing, is emphasized, as combining the outcomes generated by several peers can shrink the forecast errors of the two irradiance components by 2.2% and 3.0%.
Source: expertdata · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Solar Radiation and Photovoltaics · Solar and Space Plasma Dynamics · Atmospheric aerosols and clouds
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (68)
Show source-provided references
1. Erdener B C, Feng C, Doubleday K, et al. A review of behind-the-meter solar forecasting. Renew Sustain Energy Rev, 2022, 160: 11222410.1016/j.rser.2022.112224 ↗
2. Yang D, Xia X, Mayer M J. A tutorial review of the solar power curve: Regressions, model chains, and their hybridization and probabilistic extensions. Adv Atmos Sci, 2024, 41: 1023–106710.1007/s00376-024-3229-4 ↗
3. Yang G, Yang D, Perez M J, et al. Hydrogen production using curtailed electricity of firm photovoltaic plants: Conception, modeling, and optimization. Energy Convers Manage, 2024, 308: 11835610.1016/j.enconman.2024.118356 ↗
4. Yang D, Wang W, Gueymard C A, et al. A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutrality. Renew Sustain Energy Rev, 2022, 161: 11234810.1016/j.rser.2022.112348 ↗
5. Gandhi O, Zhang W, Kumar D S, et al. The value of solar forecasts and the cost of their errors: A review. Renew Sustain Energy Rev, 2024, 189: 11391510.1016/j.rser.2023.113915 ↗
6. Yang D, Kleissl J. Solar Irradiance and Photovoltaic Power Forecasting. Boca Raton: CRC Press, 202410.1201/9781003203971 ↗
7. Yang D, Yang G, Liu B. Combining quantiles of calibrated solar forecasts from ensemble numerical weather prediction. Renew Energy, 2023, 215: 11899310.1016/j.renene.2023.118993 ↗
8. Bauer P, Thorpe A, Brunet G. The quiet revolution of numerical weather prediction. Nature, 2015, 525: 47–5510.1038/nature14956 ↗
9. Antonanzas J, Osorio N, Escobar R, et al. Review of photovoltaic power forecasting. Sol Energy, 2016, 136: 78–11110.1016/j.solener.2016.06.069 ↗
10. Kühnert J, Lorenz E, Heinemann D. Chapter 11—Satellite-based irradiance and power forecasting for the German energy market. In: Solar Energy Forecasting and Resource Assessment. Boston: Academic Press, 2013. 267–29710.1016/B978-0-12-397177-7.00011-5 ↗
11. Zhang X, Yang D, Zhang H, et al. Spatial solar forecast verification with the neighborhood method and automatic threshold segmentation. Renew Sustain Energy Rev, 2024, 202: 11465510.1016/j.rser.2024.114655 ↗
12. André M, Perez R, Soubdhan T, et al. Preliminary assessment of two spatio-temporal forecasting technics for hourly satellite-derived irradiance in a complex meteorological context. Sol Energy, 2019, 177: 703–71210.1016/j.solener.2018.11.010 ↗
13. Aicardi D, Musé P, Alonso-Suárez R. A comparison of satellite cloud motion vectors techniques to forecast intra-day hourly solar global horizontal irradiation. Sol Energy, 2022, 233: 46–6010.1016/j.solener.2021.12.066 ↗
14. Yang D, Perez R. Can we gauge forecasts using satellite-derived solar irradiance? J Renew Sustain Energy, 2019, 11: 02370410.1063/1.5087588 ↗
15. Yang D, Bright J M. Worldwide validation of 8 satellite-derived and re-analysis solar radiation products: A preliminary evaluation and overall metrics for hourly data over 27 years. Sol Energy, 2020, 210: 3–1910.1016/j.solener.2020.04.016 ↗
16. Hammer A, Heinemann D, Lorenz E, et al. Short-term forecasting of solar radiation: A statistical approach using satellite data. Sol Energy, 1999, 67: 139–15010.1016/S0038-092X(00)00038-4 ↗
17. Yang D, Wang W, Xia X. A concise overview on solar resource assessment and forecasting. Adv Atmos Sci, 2022, 39: 1239–125110.1007/s00376-021-1372-8 ↗
18. Shi H, Yang D, Wang W, et al. First estimation of high-resolution solar photovoltaic resource maps over China with Fengyun-4A satellite and machine learning. Renew Sustain Energy Rev, 2023, 184: 11354910.1016/j.rser.2023.113549 ↗
19. Huang C, Shi H, Yang D, et al. Retrieval of sub-kilometer resolution solar irradiance from Fengyun-4A satellite using a region-adapted Heliosat-2 method. Sol Energy, 2023, 264: 11203810.1016/j.solener.2023.112038 ↗
20. Ma R, Letu H, Yang K, et al. Estimation of surface shortwave radiation from Himawari-8 satellite data based on a combination of radiative transfer and deep neural network. IEEE Trans Geosci Remote Sens, 2020, 58: 5304–531610.1109/TGRS.2019.2963262 ↗
21. Jiang H, Lu N, Qin J, et al. A deep learning algorithm to estimate hourly global solar radiation from geostationary satellite data. Renew Sustain Energy Rev, 2019, 114: 10932710.1016/j.rser.2019.109327 ↗
22. Yang Y, Sun W, Chi Y, et al. Machine learning-based retrieval of day and night cloud macrophysical parameters over East Asia using Himawari-8 data. Remote Sens Environ, 2022, 273: 11297110.1016/j.rse.2022.112971 ↗
23. Kallio-Myers V, Riihelä A, Lahtinen P, et al. Global horizontal irradiance forecast for Finland based on geostationary weather satellite data. Sol Energy, 2020, 198: 68–8010.1016/j.solener.2020.01.008 ↗
24. Rigollier C, Lefèvre M, Wald L. The method Heliosat-2 for deriving shortwave solar radiation from satellite images. Sol Energy, 2004, 77: 159–16910.1016/j.solener.2004.04.017 ↗
25. Mouhamet D, Tommy A, Primerose A, et al. Improving the Heliosat-2 method for surface solar irradiation estimation under cloudy sky areas. Sol Energy, 2018, 169: 565–57610.1016/j.solener.2018.05.032 ↗
26. Lorenz E, Hammer A, Heinemann D. Short term forecasting of solar radiation based on satellite data. In: Proceedings of the EUROSUN2004 (ISES Europe Solar Congress). Freiburg, 2004. 841–848
27. Lucas B D, Kanade T. An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence. Vancouver, 1981. 674–679
28. Horn B K P, Schunck B G. Determining optical flow. Artif Intell, 1981, 17: 185–20310.1016/0004-3702(81)90024-2 ↗
29. Farnebäck G. Two-frame motion estimation based on polynomial expansion. In: Image Analysis. Berlin, Heidelberg: Springer, 2003. 363–37010.1007/3-540-45103-X_50 ↗
30. Zach C, Pock T, Bischof H. A duality based approach for realtime TV-L1 optical flow. In: Pattern Recognition. Berlin, Heidelberg: Springer, 2007. 214–22310.1007/978-3-540-74936-3_22 ↗
31. Urbich I, Bendix J, Müller R. The seamless solar radiation (SESORA) forecast for solar surface irradiance—Method and validation. Remote Sens, 2019, 11: 257610.3390/rs11212576 ↗
32. Cros S, Sébastien N, Liandrat O, et al. Cloud pattern prediction from geostationary meteorological satellite images for solar energy forecasting. In: Proceedings of the SPIE Remote Sensing. Amsterdam, 2014
33. Huang C, Shi H, Gao L, et al. Fengyun-4 geostationary satellite-based solar energy nowcasting system and its application in North China. Adv Atmos Sci, 2022, 39: 1316–132810.1007/s00376-022-1464-0 ↗
34. Roy A, Hammer A, Heinemann D, et al. Impact of tropical convective conditions on solar irradiance forecasting based on cloud motion vectors. Environ Res Lett, 2022, 17: 10404810.1088/1748-9326/ac94e6 ↗
35. Hong T, Pinson P, Wang Y, et al. Energy forecasting: A review and outlook. IEEE Open J Power Energy, 2020, 7: 376–38810.1109/OAJPE.2020.3029979 ↗
36. Yang D. A guideline to solar forecasting research practice: Reproducible, operational, probabilistic or physically-based, ensemble, and skill (ROPES). J Renew Sustain Energy, 2019, 11: 02270110.1063/1.5087462 ↗
37. Hubicka K, Marcjasz G, Weron R. A note on averaging day-ahead electricity price forecasts across calibration windows. IEEE Trans Sustain Energy, 2019, 10: 321–32310.1109/TSTE.2018.2869557 ↗
38. Sánchez Pérez J, Meinhardt-Llopis E, Facciolo G. TV-L1 optical flow estimation. Image Process On Line, 2013, 3: 137–15010.5201/ipol.2013.26 ↗
39. Bouguet J-Y. Pyramidal implementation of the Lucas Kanade feature tracker. https://api.semanticscholar.org/CorpusID:9350588
40. Pock T, Urschler M, Zach C, et al. A duality based algorithm for TV-L1-optical-flow image registration. In: Lecture Notes in Computer Science. Berlin, Heidelberg: Springer, 2007. 511–518
41. Rudin L I, Osher S, Fatemi E. Nonlinear total variation based noise removal algorithms. Physica D-Nonlinear Phenomena, 1992, 60: 259–26810.1016/0167-2789(92)90242-F ↗
42. Chen X M, Li Y, Wang R Z. Performance study of affine transformation and the advanced clear-sky model to improve intra-day solar forecasts. J Renew Sustain Energy, 2020, 12: 04370310.1063/5.0009155 ↗
43. Yang L, Gao X, Li Z, et al. Nowcasting of surface solar irradiance using FengYun-4 satellite observations over China. Remote Sens, 2019, 11: 198410.3390/rs11171984 ↗
44. Schmit T J, Griffith P, Gunshor M M, et al. A closer look at the ABI on the GOES-R series. Bull Am Meteorol Soc, 2017, 98: 681–69810.1175/BAMS-D-15-00230.1 ↗
45. Schmetz J, Pili P, Tjemkes S, et al. Supplement to an introduction to meteosat second generation (MSG). Bull Amer Meteor Soc, 2002, 83: 99210.1175/BAMS-83-7-Schmetz-2 ↗
46. Shi H, Li W, Fan X, et al. First assessment of surface solar irradiance derived from Himawari-8 across China. Sol Energy, 2018, 174: 164–17010.1016/j.solener.2018.09.015 ↗
47. Huang C, Shi H, Yang G, et al. Autonomous solar resourcing in China with Fengyun-2. Sol Energy, 2025, 296: 11359310.1016/j.solener.2025.113593 ↗
48. Gelaro R, McCarty W, Suárez M J, et al. The modern-era retrospective analysis for research and applications, version 2 (MERRA-2). J Clim, 2017, 30: 5419–545410.1175/JCLI-D-16-0758.1 ↗
49. Randles C A, da Silva A M, Buchard V, et al. The MERRA-2 aerosol reanalysis, 1980 onward. Part I: System description and data assimilation evaluation. J Clim, 2017, 30: 6823–685010.1175/JCLI-D-16-0609.1 ↗
50. Du Y, Shi H, Zhang J, et al. Evaluation of MERRA-2 hourly surface solar radiation across China. Sol Energy, 2022, 234: 103–11010.1016/j.solener.2022.01.066 ↗
51. Buchard V, Randles C A, da Silva A M, et al. The MERRA-2 aerosol reanalysis, 1980 onward. Part II: Evaluation and case studies. J Clim, 2017, 30: 6851–687210.1175/JCLI-D-16-0613.1 ↗
52. Yang Y, Zhou M, Langerock B, et al. New ground-based Fouriertransform near-infrared solar absorption measurements of XCO2, XCH4 and XCO at Xianghe, China. Earth Syst Sci Data, 2020, 12: 1679–169610.5194/essd-12-1679-2020 ↗
53. Liu M, Xia X, Fu D, et al. Development and validation of machine-learning clear-sky detection method using 1-min irradiance data and sky imagers at a polluted suburban site, Xianghe. Remote Sens, 2021, 13: 376310.3390/rs13183763 ↗
54. Driemel A, Augustine J, Behrens K, et al. Baseline Surface Radiation Network (BSRN): Structure and data description (1992–2017). Earth Syst Sci Data, 2018, 10: 1491–150110.5194/essd-10-1491-2018 ↗
55. Yang D. Choice of clear-sky model in solar forecasting. J Renew Sustain Energy, 2020, 12: 02610110.1063/5.0003495 ↗
56. Sun X, Bright J M, Gueymard C A, et al. Worldwide performance assessment of 75 global clear-sky irradiance models using principal component analysis. Renew Sustain Energy Rev, 2019, 111: 550–57010.1016/j.rser.2019.04.006 ↗
57. Sun X, Bright J M, Gueymard C A, et al. Worldwide performance assessment of 95 direct and diffuse clear-sky irradiance models using principal component analysis. Renew Sustain Energy Rev, 2021, 135: 11008710.1016/j.rser.2020.110087 ↗
58. Gueymard C A. REST2: High-performance solar radiation model for cloudless-sky irradiance, illuminance, and photosynthetically active radiation—Validation with a benchmark dataset. Sol Energy, 2008, 82: 272–28510.1016/j.solener.2007.04.008 ↗
59. Rigollier C, Lefèvre M, Wald L. The method Heliosat-2 for deriving shortwave solar radiation from satellite images. Sol Energy, 2004, 77: 159–16910.1016/j.solener.2004.04.017 ↗
60. Fillol E, Albarelo T, Primerose A, et al. Spatiotemporal indicators of solar energy potential in the Guiana Shield using GOES images. Renew Energy, 2017, 111: 11–2510.1016/j.renene.2017.03.081 ↗
61. Valor E, Puchades J, Niclos R, et al. Determination and evaluation of surface solar irradiance with the MAGIC-Heliosat method adapted to MTSAT-2/imager and Himawari-8/AHI sensors. IEEE Trans Geosci Remote Sens, 2023, 61: 1–1910.1109/TGRS.2023.3238180 ↗
62. Amillo A, Huld T, Müller R. A new database of global and direct solar radiation using the eastern meteosat satellite, models and validation. Remote Sens, 2014, 6: 8165–818910.3390/rs6098165 ↗
63. Pfeifroth U, Kothe S, Müller R, et al. Surface radiation data set—Heliosat (SARAH)—Edition 2. Satellite Application Facility on Climate Monitoring, 2017
64. Yang L, Gao X, Hua J, et al. Very short-term surface solar irradiance forecasting based on FengYun-4 geostationary satellite. Sensors, 2020, 20: 260610.3390/s20092606 ↗
65. Huang C, Li J, Sun W, et al. Long-term variation assessment of aerosol load and dominant types over Asia for air quality studies using multi-sources aerosol datasets. Remote Sens, 2021, 13: 311610.3390/rs13163116 ↗
66. Yang D. A correct validation of the National Solar Radiation Data Base (NSRDB). Renew Sustain Energy Rev, 2018, 97: 152–15510.1016/j.rser.2018.08.023 ↗
67. Wang X, Hyndman R J, Li F, et al. Forecast combinations: An over 50-year review. Int J Forecast, 2023, 39: 1518–154710.1016/j.ijforecast.2022.11.005 ↗
68. Armstrong S. Principles of Forecasting: A Handbook for Researchers and Practitioners. New York: Springer, 200110.1007/978-0-306-47630-3 ↗