A Novel Hybrid Spatiotemporal Missing Value Imputation Approach for Rainfall Data: An Application to the Ratnapura Area, Sri Lanka
Source abstract
Abstract
Meteorological time series, such as rainfall data, show spatiotemporal characteristics and are often faced with the problem of containing missing values. Discarding missing values or modeling data with missing values causes negative impacts on the accuracy of the final predictions. Hence, accurately estimating missing values by considering the spatiotemporal variations in data has become a crucial step in eco-hydrological modeling. The multi-layer perceptron (MLP) is a promising tool for modeling temporal variation, while spatial kriging (SK) is a promising tool for capturing spatial variations. Therefore, in this study, we propose a novel hybrid approach combining the multi-layer perceptron method and spatial kriging to impute missing values in rainfall data. The proposed approach was tested using spatiotemporal data collected from a set of nearby rainfall gauging stations in the Ratnapura area, Sri Lanka. Missing values are present in collected rainfall data consecutively for a considerably longer period. This pattern has scattered among stations discontinuously over five years. The proposed hybrid model captures the temporal variability and spatial variability of the rainfall data through MLP and SK, respectively. It integrates predictions obtained through both MLP and SK with a novel optimal weight allocation method. The performance of the model was compared with individual approaches, MLP, SK, and spatiotemporal kriging. The results indicate that the novel hybrid approach outperforms spatiotemporal kriging and the other two pure approaches.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hydrological Forecasting Using AI · Hydrology and Watershed Management Studies · Air Quality Monitoring and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Statistics, University of Colombo, Colombo P.O. Box 1490, Sri Lanka
School of Info Technology, Faculty of Science, Engineering and Built Environment, Geelong Waurn Ponds Campus, Deakin University, Geelong, VIC 3216, Australia
Funding
University of Colombo, Sri Lanka
References (28)
Show source-provided references
1. Sequential Imputation of Missing Spatio-Temporal Precipitation Data Using Random Forests10.3389/frwa.2020.00020 ↗
2. Asadi, R., and Regan, A. (2019). A convolution recurrent autoencoder for spatio-temporal missing data imputation. arXiv.
3. Soley-Bori, M. (2013). Dealing with Missing Data: Key Assumptions and Methods for Applied Analysis, Boston University.
4. Yang, H., Yang, J., Han, L., Liu, X., Pu, L., Chin, S., and Hwang, H. (2018). A Kriging based spatiotemporal approach for traffic volume data imputation. PLoS ONE., 13.10.1371/journal.pone.0195957 ↗
5. Agarwal, A. (2011). A New Approach to Spatio-Temporal Kriging and Its Applications. [Master’s Thesis, Ohio State University, OhioLINK Electronic Theses and Dissertations Center]. Available online: http://rave.ohiolink.edu/etdc/view?acc_num=osu1306871646.
6. Estimating extremely large amounts of missing precipitation data10.2166/hydro.2020.127 ↗
7. CUTOFF: A spatio-temporal imputation method10.1016/j.jhydrol.2014.11.012 ↗
8. Hettiarachchi, P. (2013). Inundation Maps of the Kalu Ganga Basin during the Flood in May 2003, Department of Irrigation.
9. Use of a hydrodynamic model to forecast floods of Kalu River in Sri Lanka10.1111/j.1753-318X.2009.01032.x ↗
10. Rafii, F., and Kechadi, T. (2019, January 2–4). Collection of historical weather data: Issues with missing values. Proceedings of the 4th International Conference on Smart City Applications (SCA’19), Casablanca, Morocco.10.1145/3368756.3368974 ↗
11. Imputation of Missing Rainfall Data Using Revised Normal Ratio Method10.1166/asl.2017.10203 ↗
12. Comparison of Missing Value Estimation Techniques in Rainfall Data of Bangladesh10.1007/s00704-018-2537-y ↗
13. Estimation of missing rainfall data using spatial interpolation and imputation methods10.1063/1.4907423 ↗
14. A robust deep learning model for missing value imputation in big NCDC dataset10.1007/s42044-020-00065-z ↗
15. Missing data imputation of high-resolution temporal climate time series data10.1002/met.1873 ↗
16. Estimation the Missing Data of Meteorological Variables in Different Iraqi Cities By using ARIMA Model
17. Medeiros, E., De Lima, R., Olinda, R., and Santos, C. (2019). Modeling Spatiotemporal Rainfall Variability in Paraíba, Brazil. Water, 11.10.3390/w11091843 ↗
18. Cuenca, J., Correa-Flórez, C., Patino, D., and Vuelvas, J. (2020). Spatio-Temporal Kriging Based Economic Dispatch Problem Including Wind Uncertainty. Energies., 13.10.20944/preprints202010.0513.v1 ↗
19. An efficient realization of deep learning for traffic data imputation10.1016/j.trc.2016.09.015 ↗
20. Spatio-temporal regression Kriging for modelling urban NO2 concentrations Spatio-temporal regression Kriging for modelling urban NO2 concentrations10.1080/13658816.2019.1667501 ↗
21. Missing data imputation for traffic flow speed using spatio-temporal cokriging10.1016/j.trc.2018.01.015 ↗
22. Srinivasan, B., Duraiswami, R., and Murtugudde, R. (2010, January 18–21). Efficient Kriging for real-time spatio-temporal interpolation. Proceedings of the 20th Conference on Probability and Statistics in the Atmospheric Sciences, Atlanta, Georgia.
23. Chapter Fourteen-Energy-efficient edge based real-time healthcare support system10.1016/bs.adcom.2019.09.007 ↗
24. EEG signals classification using the K-means clustering and a multilayer perceptron neural network model10.1016/j.eswa.2011.04.149 ↗
25. Artificial neural networks (the multilayer perceptron)—A review of applications in the atmospheric sciences10.1016/S1352-2310(97)00447-0 ↗
26. Grosse, R. (2022, January 16). Lecture 5: Multilayer Perceptrons. Available online: https://www.cs.toronto.edu/~rgrosse/courses/csc321_2018/readings/L05%20Multilayer%20Perceptrons.pdf.
27. Huang, C., Chan, Y.W., and Yen, N. (2020). Data Processing Techniques and Applications for Cyber-Physical Systems (DPTA 2019)–Advances in Intelligent Systems and Computing, Springer.10.1007/978-981-15-1468-5 ↗
28. Appropriate conventional methods forestimating missing precipitation values in Sri Lanka10.4038/java.v5i2.47 ↗