journal article·2021-02-06Open access

Reconstruction of Missing Data in Weather Radar Image Sequences Using Deep Neuron Networks

Lihao Gao, Yu Zheng, Yaqiang Wang, Jiangjiang Xia, Xunlai Chen, Bin Li, Ming Luo, Yuchen Guo

Applied Sciences· Volume 11· Issue 4

Abstract

Missing data in weather radar image sequences may cause bias in quantitative precipitation estimation (QPE) and quantitative precipitation forecast (QPF) studies, and also the obtainment of corresponding high-quality QPE and QPF products. The traditional approaches that are used to reconstruct missing weather radar images replace missing frames with the nearest image or with interpolated images. However, the performance of these approaches is defective, and their accuracy is quite limited due to neglecting the intensification and disappearance of radar echoes. In this study, we propose a deep neuron network (DNN), which combines convolutional neural networks (CNNs) and bi-directional convolutional long short-term memory networks (CNN-BiConvLSTMs), to address this problem and establish a deep-learning benchmark. The model is trained to be capable of dealing with arbitrary missing patterns by using the proposed training schedule. Then the performances of the model are evaluated and compared with baseline models for different missing patterns. These baseline models include the nearest neighbor approach, linear interpolation, optical flow methods, and two DNN models three-dimensional CNN (3DCNN) and CNN-ConvLSTM. Experimental results show that the CNN-BiConvLSTM model outperforms all other baseline models. The influence of data quality on interpolation methods is further investigated, and the CNN-BiConvLSTM model is found to be basically uninfluenced by less qualified input weather radar images, which reflects the robustness of the model. Our results suggest good prospects for applying the CNN-BiConvLSTM model to improve the quality of weather radar datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Precipitation Measurement and Analysis · Meteorological Phenomena and Simulations · Flood Risk Assessment and Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Artificial Intelligence for Meteorology, Chinese Academy of Meteorological Sciences, Beijing 100081, China

Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China

Key Laboratory of Regional Climate-Environment for East Asia, Institute of Atmospheric Physics, Chinese Academy of Sciences, Beijing 100081, China

Shenzhen Key Laboratory of Severe Weather in South China, Shenzhen Meteorological Bureau, Shenzhen 518040, China

Shenzhen National Climatological Observatory, Shenzhen 518040, China

Huafeng Meteorological Media Group, Beijing Jiutian Meteorological Technology Co. Ltd., Beijing 100081, China

Funding

Basic Creative Research Fund of Huafeng Meteorological Media Group · National Key Research and Development Program of China for Intergovernmental Cooperation · Basic Research Fund of Chinese Academy of Meteorological Sciences

References (57)

Show source-provided references
1. The CASA quantitative precipitation estimation system: A five year validation study10.5194/nhess-12-2811-2012 ↗
2. Huang, H., Zhao, K., Zhang, G., Lin, Q., Wen, L., Chen, G., Yang, Z., Wang, M., and Hu, D. (2018). Quantitative Precipitation Estimation with Operational Polarimetric Radar Measurements in Southern China: A Differential Phase-Based Variational Approach. J. Atmos. Ocean. Technol., 35.10.1175/JTECH-D-17-0142.1 ↗
3. Liguori, S., and Rico-Ramirez, M. (2013). A review of current approaches to radar based Quantitative Precipitation Forecasts. Int. J. River Basin Manag., 12.10.1080/15715124.2013.848872 ↗
4. Novák, P., Březková, L., Frolík, P., and Šálek, M. (2007). Quantitative precipitation forecast using radar echo extrapolation. Atmos. Res., 93.10.1016/j.atmosres.2008.10.014 ↗
5. Lepot, M., Aubin, J.-B., and Clemens, F.H.L.R. (2017). Interpolation in Time Series: An Introductive Overview of Existing Methods, Their Performance Criteria and Uncertainty Assessment. Water, 9.10.3390/w9100796 ↗
6. Cosgrove, B.A., Lohmann, D., Mitchell, K.E., Houser, P.R., Wood, E.F., Schaake, J.C., Robock, A., Marshall, C., Sheffield, J., and Duan, Q. (2003). Real-time and retrospective forcing in the North American Land Data Assimilation System (NLDAS) project. J. Geophys. Res. Atmos., 108.10.1029/2002JD003118 ↗
7. Piccolo, F., and Chirico, G.B. (2005). Sampling errors in rainfall measurements by weather radar. Adv. Geosci., 2.10.5194/adgeo-2-151-2005 ↗
8. Langston, C., Zhang, J., and Howard, K. (2007). Four-Dimensional Dynamic Radar Mosaic. J. Atmos. Ocean. Technol., 24.10.1175/JTECH2001.1 ↗
9. Weather Radar Data Interpolation Using a Kernel-Based Lagrangian Nowcasting Technique10.1109/TGRS.2014.2368076 ↗
10. Spatio-Temporal Image Pattern Prediction Method Based on a Physical Model With Time-Varying Optical Flow10.1109/TGRS.2012.2212201 ↗
11. Nowcasting of Motion and Growth of Precipitation with Radar over a Complex Orography10.1175/1520-0450(1995)034<1286:NOMAGO>2.0.CO;2 ↗
12. Optical flow models as an open benchmark for radar-based precipitation nowcasting (rainymotion v0.1)10.5194/gmd-12-1387-2019 ↗
13. Gridded surface wind fields from Metop/ASCAT measurements10.1080/01431161.2011.600348 ↗
14. Paulson, K.S. (2004). Fractal interpolation of rain rate time series. J. Geophys. Res., 109.10.1029/2004JD004717 ↗
15. Woo, W.-C., and Wong, W.-K. (2017). Operational application of optical flow techniques to radar-based rainfall nowcasting. Atmosphere, 8.10.3390/atmos8030048 ↗
16. Scale-Dependence of the Predictability of Precipitation from Continental Radar Images. Part I: Description of the Methodology10.1175/1520-0493(2002)130<2859:SDOTPO>2.0.CO;2 ↗
17. Quantitative Precipitation Nowcasting: A Lagrangian Pixel-Based Approach10.1016/j.atmosres.2012.07.001 ↗
18. A new methodology for pixel-quantitative precipitation nowcasting using a pyramid Lucas Kanade optical flow approach10.1016/j.jhydrol.2015.07.042 ↗
19. A large-sample investigation of statistical procedures for radar-based short-term quantitative precipitation forecasting10.1016/S0022-1694(00)00360-7 ↗
20. The use of digital weather radar records for short-term precipitation forecasting
21. Lucas, B.D., and Kanade, T. (1981, January 24–28). An iterative image registration technique with an application to stereo vision. Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada.
22. Determining optical flow10.1016/0004-3702(81)90024-2 ↗
23. Joyce, R., Janowiak, J., Arkin, P., and Xie, P. (2004). CMORPH: A Method That Produces Global Precipitation Estimates from Passive Microwave and Infrared Data at High Spatial and Temporal Resolution. J. Hydrol., 5.10.1175/1525-7541(2004)005<0487:CAMTPG>2.0.CO;2 ↗
24. The CASA Nowcasting System10.1175/2011JTECHA1496.1 ↗
25. Bias adjustment and advection interpolation of long-term high resolution radar rainfall series10.1016/j.jhydrol.2013.10.056 ↗
26. A numerical method to generate high temporal resolution precipitation time series by combining weather radar measurements with a nowcast model10.1016/j.atmosres.2013.10.015 ↗
27. RainNet v1.0: A convolutional neural network for radar-based precipitation nowcasting10.5194/gmd-13-2631-2020 ↗
28. Shi, X.J., Chen, Z.R., Wang, H., Yeung, D.Y., Wong, W.K., and Woo, W.C. (2015, January 7–12). Convolutional LSTM network: A machine learning approach for precipitation nowcasting. Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
29. Learning spatial-temporal features for video copy detection by the combination of CNN and RNN10.1016/j.jvcir.2018.05.013 ↗
30. Zhang, T., Zheng, W., Cui, Z., Zong, Y., and Li, Y. (2018). Spatial-Temporal Recurrent Neural Network for Emotion Recognition. IEEE Trans. Cybern., 839–847.10.1109/TCYB.2017.2788081 ↗
31. Fuentes-Pacheco, J., Torres-Olivares, J., Roman-Rangel, E., Cervantes, S., Juarez-Lopez, P., Hermosillo-Valadez, J., and Rendón-Mancha, J.M. (2019). Fig Plant Segmentation from Aerial Images Using a Deep Convolutional Encoder-Decoder Network. Remote Sens., 11.10.3390/rs11101157 ↗
32. Javaloy, A., and García-Mateos, G. (2020). Text Normalization Using Encoder–Decoder Networks Based on the Causal Feature Extractor. Appl. Sci., 10.10.3390/app10134551 ↗
33. Zhang, H., Ma, C., Pazzi, V., Zou, Y., and Casagli, N. (2020). Microseismic Signal Denoising and Separation Based on Fully Convolutional Encoder–Decoder Network. Appl. Sci., 10.10.3390/app10186621 ↗
34. Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to sequence learning with neural networks. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, Inc.
35. Donahue, J., Hendricks, L., Guadarrama, S., Rohrbach, M., Venugopalan, S., Darrell, T., and Saenko, K. (2015, January 7–12). Long-term recurrent convolutional networks for visual recognition and description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298878 ↗
36. Long Short-term Memory10.1162/neco.1997.9.8.1735 ↗
37. Srivastava, N., Mansimov, E., and Salakhutdinov, R. (2015, January 7–9). Unsupervised learning of video representations using LSTMs. Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille, France.
38. Shi, X., Gao, Z., Lausen, L., Wang, H., Yeung, D.Y., Wong, W.K., and Woo, W.C. (2017, January 4–9). Deep learning for precipitation nowcasting: A benchmark and a new model. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
39. PredRNN++: Towards a resolution of the deep-in-time dilemma in spatiotemporal predictive learning
40. Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs. Advances in Neural Information Processing Systems 30, Curran Associates, Inc.
41. Wang, Y., Zhang, J., Zhu, H., Long, M., Wang, J., and Yu, P.S. (2019, January 16–20). Memory in memory: A predictive neural network for learning higher-order non-stationarity from spatiotemporal dynamics. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00937 ↗
42. Wang, Y., Jiang, L., Yang, M.H., Li, L.J., Long, M., and Fei-Fei, L. (2019, January 6–9). Eidetic 3D LSTM: A Model for Video Prediction and Beyond. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA.
43. U-Net: Convolutional Networks for Biomedical Image Segmentation
44. Peng, D., Zhang, Y., and Guan, H. (2019). End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet++. Remote Sens., 11.10.3390/rs11111382 ↗
45. Chen, S., Zhang, S., Geng, H., Chen, Y., Zhang, C., and Min, J. (2020). Strong Spatiotemporal Radar Echo Nowcasting Combining 3DCNN and Bi-Directional Convolutional LSTM. Atmosphere, 11.10.3390/atmos11060569 ↗
46. Chang, Y., and Luo, B. (2019). Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution. Remote Sens., 11.10.3390/rs11202333 ↗
47. Kroeger, T., Timofte, R., Dai, D., and Van Gool, L. (2016, January 8–16). Fast optical flow using dense inverse search. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46493-0_29 ↗
48. Development of a precipitation nowcasting algorithm based upon optical flow techniques10.1016/j.jhydrol.2003.11.011 ↗
49. Inter-comparison of radar rainfall rate using constant altitude plan position indicator and hybrid surface rainfall maps10.1016/j.jhydrol.2015.08.063 ↗
50. Kingma, D., and Ba, J. (2015, January 7–9). Adam: A method for Stochastic Optimization. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA.
51. The Evaluation of Yes/No Forecasts for Scientific and Administrative Purposes10.1175/1520-0493(1976)104<1209:TEOYFF>2.0.CO;2 ↗
52. Deep learning and process understanding for data-driven Earth system science10.1038/s41586-019-0912-1 ↗
53. Vandal, T., and Nemani, R. (2020, January 24). Temporal Interpolation of Geostationary Satellite Imagery with Task Specific Optical Flow. Proceedings of the 1st ACM SIGKDD Workshop on Deep Learning for Spatiotemporal Data, Applications, and Systems (DeepSpatial ’20), Virtual Conference.
54. Cruz, L.F., Saito, P.T.M., and Bugatti, P.H. (2020, January 12–14). DeepCloud: An Investigation of Geostationary Satellite Imagery Frame Interpolation for Improved Temporal Resolution. Proceedings of the 19th International Conference on Artificial Intelligence and Soft Computing, Zakopane, Poland.10.1007/978-3-030-61401-0_5 ↗
55. Small and slim deep convolutional neural network for mobile device10.1109/ACCESS.2020.3005161 ↗
56. Tai, Y., Yang, J., Liu, X., and Xu, C. (2017, January 22–29). MemNet: A Persistent Memory Network for Image Restoration. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.486 ↗
57. Guo, Z., Sun, Y., Jian, M., and Zhang, X. (2018). Deep Residual Network with Sparse Feedback for Image Restoration. Appl. Sci., 8.10.3390/app8122417 ↗