Comparison of Artificial Neural Network and Regression Models for Filling Temporal Gaps of Meteorological Variables Time Series
Source abstract
Abstract
Continuous meteorological variable time series are highly demanded for various climate related studies. Five statistical models were tested for application of temporal gaps filling in time series of surface air pressure, air temperature, relative air humidity, incoming solar radiation, net radiation, and soil temperature. A bilayer artificial neural network, linear regression, linear regression with interactions, and the Gaussian process regression models with exponential and rational quadratic kernel were used to fill the gaps. Models were driven by continuous time series of meteorological variables from the ECMWF (European Centre for Medium-range Weather Forecasts) ERA5-Land reanalysis. Raw ECMWF ERA5-Land reanalysis data are not applicable for characterization of specific local weather conditions. The linear correlation coefficients (CC) between ERA5-Land data and in situ observations vary from 0.61 (for wind direction) to 0.99 (for atmospheric pressure). The mean difference is high and estimated at 3.2 °C for air temperature and 3.5 hPa for atmospheric pressure. The normalized root-mean-square error (NRMSE) is 5–13%, except for wind direction (NRMSE = 49%). The linear bias correction of ERA5-Land data improves matching between the local and reanalysis data for all meteorological variables. The Gaussian process regression model with an exponential kernel based or bilayered artificial neural network trained on ERA5-Land data significantly shifts raw ERA5-Land data toward the observed values. The NRMSE values reduce to 2–11% for all variables, except wind direction (NRMSE = 22%). CC for the model is above 0.87, except for wind characteristics. The suggested model calibrated against in situ observations can be applied for gap-filling of time series of meteorological variables.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Climate variability and models · Meteorological Phenomena and Simulations · Plant Water Relations and Carbon Dynamics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Monitoring of Climatic and Ecological System SB RAS, Tomsk 634055, Russia
Laboratory of ecosystem-atmosphere interactions in forest-bog complexes, Yugra State University, Khanty-Mansiysk 628012, Russia
A. M. Obukhov Institute of Atmospheric Physics, Moscow 119017, Russia
Funding
Ministry of Science and Higher Education of the Russian Federation · Tyumen region Government · Russian Scientific Foundation
References (61)
Show source-provided references
1. Masson-Delmotte, V.P., Zhai, A., Pirani, S.L., Connors, C., Péan, S., Berger, N., Caud, Y., Chen, L., Goldfarb, M.I., and Gomis, M. (2021). Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press.
2. Climate change scenario services: From science to facilitating action10.1016/j.oneear.2021.07.015 ↗
3. What data analytics can or cannot do for climate change studies: An inventory of interactive visual tools10.1016/j.ecoinf.2022.101918 ↗
4. Kharyutkina, E., Loginov, S., Martynova, Y.V., and Sudakov, I. (2022). Time series analysis of atmospheric precipitation characteristics in Western Siberia for 1979–2018 across different datasets. Atmosphere, 13.10.3390/atmos13020189 ↗
5. Perception of climate change10.1073/pnas.1205276109 ↗
6. Observed and simulated temperature extremes during the recent warming hiatus10.1088/1748-9326/9/6/064023 ↗
7. Dynamics of extreme climatic characteristics and trends of dangerous meteorological phenomena over the territory of Western Siberia10.1134/S1024856022040078 ↗
8. The FLUXNET2015 dataset and the ONEFlux processing pipeline for eddy covariance data10.1038/s41597-020-0534-3 ↗
9. Net ecosystem exchange and energy fluxes measured with the eddy covariance technique in a western Siberian bog10.5194/acp-17-9333-2017 ↗
10. Dyukarev, E., Zarov, E., Alekseychik, P., Nijp, J., Filippova, N., Mammarella, I., Filippov, I., Bleuten, W., Khoroshavin, V., and Ganasevich, G. (2021). The multiscale monitoring of peatland ecosystem carbon cycling in the middle taiga zone of Western Siberia: The Mukhrino bog case study. Land, 10.10.3390/land10080824 ↗
11. Physical, chemical and biochemical properties of Western Siberia Sphagnum and Carex peat soils
12. A high-resolution transient 3-dimensional hydrological model of an extensive undisturbed bog complex in West Siberia
13. Sampling event dataset on five-year observations of macrofungi fruit bodies in raised bogs, Western Siberia, Russia10.3897/BDJ.7.e35674 ↗
14. Application of Artificial Neural Networks (ANNs) in the Gap Filling of Meteorological Time Series10.1590/0102-7786332013 ↗
15. Gunawardena, N., Pardyjak, E., Durand, P., Hedde, T., and Dupuy, F. (2022). Data Filling of Micrometeorological Variables in Complex Terrain for High-Resolution Nowcasting. Atmosphere, 13.10.3390/atmos13030408 ↗
16. A 16-year record (2002–2017) of permafrost, active-layer, and meteorological conditions at the Samoylov Island Arctic permafrost research site, Lena River delta, northern Siberia: An opportunity to validate remote-sensing data and land surface, snow, and permafrost models10.5194/essd-11-261-2019 ↗
17. The impact of peatland restoration on local climate: Restoration of a cool humid island10.1029/2019JG005156 ↗
18. Thermal regime of peat deposits of palsas and hollows of peat plateaus in Western Siberia
19. Seasonally frozen layer of peatlands in the southern taiga zone of Western Siberia
20. Gap-filling meteorological data series using the GapMET software in the state of Mato Grosso, Brazil
21. High-resolution bias corrected precipitation data over the South Siberia, Russia10.1016/j.atmosres.2021.105528 ↗
22. Bias correction of regional climate model simulations for hydrological climate-change impact studies: Review and evaluation of different methods10.1016/j.jhydrol.2012.05.052 ↗
23. Gyawali, B., Ahmed, M., Murgulet, D., and Wiese, D.N. (2022). Filling temporal gaps within and between GRACE and GRACE-FO terrestrial water storage records: An innovative approach. Remote Sens., 14.10.3390/rs14071565 ↗
24. Jehanzaib, M., Ajmal, M., Achite, M., and Kim, T.-W. (2022). Comprehensive review: Advancements in rainfall-runoff modelling for flood mitigation. Climate, 10.10.3390/cli10100147 ↗
25. Sun, T., Huang, X., Liang, C., Liu, R., and Huang, X. (2022). Prediction and analysis of dew point indirect evaporative cooler performance by artificial neural network method. Energies, 15.10.3390/en15134673 ↗
26. Khan, M.S., Jeon, S.B., and Jeong, M.-H. (2021). Gap-filling eddy covariance latent heat flux: Inter-comparison of four machine learning model predictions and uncertainties in forest ecosystem. Remote Sens., 13.10.3390/rs13244976 ↗
27. Developing machine learning algorithms for meteorological temperature and humidity forecasting at Terengganu state in Malaysia10.1038/s41598-021-96872-w ↗
28. Su, H., Jiang, J., Wang, A., Zhuang, W., and Yan, X.-H. (2022). Subsurface temperature reconstruction for the global ocean from 1993 to 2020 using satellite observations and deep learning. Remote Sens., 14.10.3390/rs14133198 ↗
29. Rainfall forecasting model using machine learning methods: Case study Terengganu, Malaysia10.1016/j.asej.2020.09.011 ↗
30. Investigating photovoltaic solar power output forecasting using machine learning algorithms
31. Innovative gap-filling strategy for annual sums of CO2 net ecosystem exchange10.1016/j.agrformet.2006.03.003 ↗
32. A physical full-factorial scheme for gap-filling of eddy covariance measurements of daytime evapotranspiration10.1016/j.agrformet.2022.109087 ↗
33. Gap filling strategies for long term energy flux data sets10.1016/S0168-1923(00)00235-5 ↗
34. Gap-filling eddy covariance methane fluxes: Comparison of machine learning model predictions and uncertainties at FLUXNET-CH4 wetlands10.1016/j.agrformet.2021.108528 ↗
35. Filling the gaps in meteorological continuous data measured at FLUXNET sites with ERA-Interim reanalysis10.5194/essd-7-157-2015 ↗
36. Near-real-time adjusted reanalysis forcing data for hydrology10.5194/hess-22-989-2018 ↗
37. Maraun, D., and Widmann, M. (2018). Statistical Downscaling and Bias Correction for Climate Research, Cambridge University Press.10.1017/9781107588783 ↗
38. Inter-comparison of statistical downscaling methods for projection of extreme precipitation in Europe10.5194/hess-19-1827-2015 ↗
39. A downscaling approach for constructing high-resolution precipitation dataset over the Tibetan Plateau from ERA5 reanalysis10.1016/j.atmosres.2021.105574 ↗
40. Dynamical downscaling of global reanalysis data for high-resolution spatial modeling of snow accumulation/melting at the central/southern Sierra Nevada watersheds10.1016/j.jhydrol.2021.126445 ↗
41. Addressing climate information needs at the regionallevel: The CORDEX framework
42. Comparison of gap-filling techniques applied to the CCI soil moisture database in Southern Europe10.1016/j.rse.2021.112377 ↗
43. Regional sub-daily stochastic weather generator based on reanalyses for surface water stress estimation in central Tunisia10.1016/j.envsoft.2022.105448 ↗
44. Multiple gap-filling for eddy covariance datasets10.1016/j.agrformet.2022.109114 ↗
45. Recommendations for gap-filling eddy covariance latent heat flux measurements using marginal distribution sampling10.1007/s00704-019-02975-w ↗
46. Filling gaps of black-sky surface albedo of the Arctic sea ice using gradient boosting and brightness temperature data
47. Peng, Z., Ding, Y., Qu, Y., Wang, M., and Li, X. (2022). Generating a Long-Term Spatiotemporally Continuous Melt Pond Fraction Dataset for Arctic Sea Ice Using an Artificial Neural Network and a Statistical-Based Temporal Filter. Remote Sens., 14.10.3390/rs14184538 ↗
48. Application of artificial neural networks for the spatial estimation of wind speed in a coastal region with complex topography10.1016/j.renene.2011.07.007 ↗
49. Hydrometeorological dataset of West Siberian boreal peatland: A 10-year record from the Mukhrino field station10.5194/essd-13-2595-2021 ↗
50. Dyukarev, E., Filippova, N., Karpov, D., Shnyrev, N., Zarov, E., Filippov, I., Voropay, N., Avilov, V., Artamonov, A., and Lapshina, E. Hydrometeorological Dataset of West Siberian Boreal Peatland: A 10-Year Records from the Mukhrino Field Station. Dataset. Version 2020/12.10.5194/essd-2020-391 ↗
51. Hennermann, K. (2022, September 21). ERA5 Data Documentation. ECMWF. Available online: https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation.
52. Hersbach, H., de Rosnay, P., Bell, B., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Alonso-Balmaseda, M., Balsamo, G., and Bechtold, P. (2018). Operational Global Reanalysis: Progress, Future Directions and Synergies with NWP, ECMWF. ERA Rep. Ser. 27.
53. Daily evaluation of 26 precipitation datasets using Stage-IV gauge-radar data for the CONUS10.5194/hess-23-207-2019 ↗
54. Muñoz-Sabater, J. ERA5-Land hourly data from 1981 to present. Copernicus Climate Change Service (C3S) Climate Data Store (CDS).
55. Variations in resources of solar and wind energy in the Russian sector of the Arctic10.1134/S1024856020030082 ↗
56. Jolliffe, I.T. (2002). Springer Series in Statistics, Springer.
57. The MathWorks, Inc (2019). Regression Learner Math Toolbox, MathWorks, Inc.. Available online: https://www.mathworks.com/help/stats/regressionlearner-app.html.
58. Rasmussen, C.E., and Williams, C.K.I. (2006). Gaussian Processes for Machine Learning, MIT Press. Available online: https://gaussianprocess.org/gpml/.10.7551/mitpress/3206.001.0001 ↗
59. Osborne, M.A., Roberts, S.J., Rogers, A., Ramchurn, S.D., and Jennings, N.R. (2008, January 22–24). Towards Real-Time Information Processing of Sensor Network Data Using Computationally Efficient Multi-output Gaussian Processes. Proceedings of the 2008 International Conference on Information Processing in Sensor Networks (IPSN 2008), St. Louis, MO, USA.10.1109/IPSN.2008.25 ↗
60. Artificial neural network approach to spatial estimation of wind velocity data10.1016/j.enconman.2005.05.009 ↗
61. Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios10.1016/j.jhydrol.2012.01.011 ↗