journal article·2019-01-08Open access

Analysis and Impact Evaluation of Missing Data Imputation in Day-ahead PV Generation Forecasting

Taeyoung Kim, Woong Ko, Jinho Kim

Applied Sciences· Volume 9· Issue 1

Abstract

Over the past decade, PV power plants have increasingly contributed to power generation. However, PV power generation widely varies due to environmental factors; thus, the accurate forecasting of PV generation becomes essential. Meanwhile, weather data for environmental factors include many missing values; for example, when we estimated the missing values in the precipitation data of the Korea Meteorological Agency, they amounted to ~16% from 2015–2016, and further, 19% of the weather data were missing for 2017. Such missing values deteriorate the PV power generation prediction performance, and they need to be eliminated by filling in other values. Here, we explore the impact of missing data imputation methods that can be used to replace these missing values. We apply four missing data imputation methods to the training data and test data of the prediction model based on support vector regression. When the k-nearest neighbors method is applied to the test data, the prediction performance yields results closest to those for the original data with no missing values, and the prediction model’s performance is stable even when the missing data rate increases. Therefore, we conclude that the most appropriate missing data imputation for application to PV forecasting is the KNN method.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Solar Radiation and Photovoltaics · Energy Load and Power Forecasting · Wind Energy Research and Development

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Integrated Technology, Gwangju Institute of Science and Technology, Gwangju 61005, Korea

Research Institute for Solar and Sustainable Energies, Gwangju Institute of Science and Technology, Gwangju 61005, Korea

References (35)

Show source-provided references
1. (2018, August 17). Highlights of the REN21 Renewables 2018 Global Status Report in Perspective. Available online: http://www.ren21.net/wp-content/uploads/2018/06/17-8652_GSR2018_FullReport_web_final_.pdf.
2. (2018, August 17). Trends 2016 in Photovoltaic Applications. Available online: http://www.iea-pvps.org/fileadmin/dam/public/report/national/Trends_2016_-_mr.pdf.
3. History and trends in solar irradiance and PV power forecasting: A preliminary assessment and review using text mining10.1016/j.solener.2017.11.023 ↗
4. Panapakidis, I., Bouhouras, A., and Christoforidis, G. (2018, January 3–7). A missing data treatment method for photovoltaic installations. Proceedings of the IEEE International Energy Conference (ENERGYCON), Limassol, Cyprus.10.1109/ENERGYCON.2018.8398780 ↗
5. An analysis of four missing data treatment methods for supervised learning10.1080/713827181 ↗
6. Banks, D., McMorris, F., Arabie, P., and Gaul, W. (2004). Classification, Clustering, and Data Mining Applications, Springer.10.1007/978-3-642-17103-1 ↗
7. A study on the use of imputation methods for experimentation with Radial Basis Function Network classifiers handling missing attribute values: The good synergy between RBFNs and EventCovering method10.1016/j.neunet.2009.11.014 ↗
8. Forecasting power output of photovoltaic systems based on weather classification and support vector machines10.1109/TIA.2012.2190816 ↗
9. A weather-based hybrid method for 1-day ahead hourly forecasting of PV power output10.1109/TSTE.2014.2313600 ↗
10. Das, U.K., Tey, K.S., Seyedmahmoudian, M., Idna Idris, M.Y., Mekhilef, S., Horan, B., and Stojcevski, A. (2017). SVR-based model to forecast PV power generation under different weather conditions. Energies, 10.10.3390/en10070876 ↗
11. MIAEC: Missing data imputation based on the evidence chain10.1109/ACCESS.2018.2803755 ↗
12. Extreme learning machine for missing data using multiple imputations10.1016/j.neucom.2015.03.108 ↗
13. Missing data imputation of solar radiation data under different atmospheric conditions10.3390/s141120382 ↗
14. Layanun, V., Suksamosorn, S., and Songsiri, J. (2017, January 19–22). Missing-data imputation for solar irradiance forecasting in Thailand. Proceedings of the 56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), Kanazawa, Japan.10.23919/SICE.2017.8105472 ↗
15. Comparison of missing value imputation methods in time series: The case of Turkish meteorological data10.1007/s00704-012-0723-x ↗
16. Hourly Solar Radiation Estimation Using Ambient Temperature and Relative Humidity Data10.7763/IJESD.2011.V2.122 ↗
17. Improved weighting methods, deterministic and stochastic data-driven models for estimation of missing precipitation records10.1016/j.jhydrol.2005.02.015 ↗
18. Optimal functional forms for estimation of missing precipitation data10.1016/j.jhydrol.2009.06.014 ↗
19. Reconstructing missing daily precipitation data using regression trees and artificial neural networks for SWAT streamflow simulation10.1016/j.jhydrol.2010.09.005 ↗
20. Evaluation of infilling methods for time series of daily precipitation and temperature: The case of the Ecuadorian Andes10.18537/mskn.05.01.07 ↗
21. Missing data imputation using statistical and machine learning methods in a real breast cancer problem10.1016/j.artmed.2010.05.002 ↗
22. On the imputation of missing data for road traffic forecasting: New insights and novel techniques10.1016/j.trc.2018.02.021 ↗
23. Iterative multi-task learning for time-series modeling of solar panel PV outputs10.1016/j.apenergy.2017.12.058 ↗
24. A new missing data imputation algorithm applied to electrical data loggers10.3390/s151229842 ↗
25. (2017, August 17). Open Data Portal. Available online: https://www.data.go.kr/dataset/15000962/fileData.do.
26. (2017, August 17). Weather Open Data Portal. Available online: https://data.kma.go.kr/data/rmt/rmtList.do?code=400&pgmNo=570.
27. Holmgren, W.F., and Groenendyk, D.G. (2016, January 5–10). An open source solar power forecasting tool using PVLIB-Python. Proceedings of the IEEE 43rd Photovoltaic Specialists Conference (PVSC), Portland, OR, USA.10.1109/PVSC.2016.7749755 ↗
28. (2018, November 25). Summary on Solar Measurement. Available online: https://www.ammonit.com/en/wind-solar-wissen/solarmessung#top.
29. K nearest neighbours with mutual information for simultaneous classification and missing data imputation10.1016/j.neucom.2008.11.026 ↗
30. A study of K-nearest neighbour as an imputation method
31. Hruschka, E.R., Hruschka, E.R., and Ebecken, N.F. (2004, January 4–6). Towards efficient imputation by nearest-neighbors: A clustering-based approach. Proceedings of the Australasian Joint Conference on Artificial Intelligence, Cairns, Australia.10.1007/978-3-540-30549-1_45 ↗
32. Missing value estimation methods for DNA microarrays10.1093/bioinformatics/17.6.520 ↗
33. mice: Multivariate imputation by chained equations in R
34. Müller, K.-R., Smola, A.J., Rätsch, G., Schölkopf, B., Kohlmorgen, J., and Vapnik, V. (1997, January 8–10). Predicting time series with support vector machines. Proceedings of the International Conference on Artificial Neural Networks, Lausanne, Switzerland.10.1007/BFb0020283 ↗
35. Multiple imputation by chained equations: What is it and how does it work?10.1002/mpr.329 ↗