journal article·2024-07-19Open access

A 1D Convolutional Neural Network (1D-CNN) Temporal Filter for Atmospheric Variability: Reducing the Sensitivity of Filtering Accuracy to Missing Data Points

Dan Yu, Hoiio Kong, Jeremy Cheuk-Hin Leung, Pak Wai Chan, Clarence Fong, Yuchen Wang, Banglin Zhang

Applied Sciences· Volume 14· Issue 14

Abstract

The atmosphere exhibits variability across different time scales. Currently, in the field of atmospheric science, statistical filtering is one of the most widely used methods for extracting signals on certain time scales. However, signal extraction based on traditional statistical filters may be sensitive to missing data points, which are particularly common in meteorological data. To address this issue, this study applies a new type of temporal filters based on a one-dimensional convolution neural network (1D-CNN) and examines its performance on reducing such uncertainties. As an example, we investigate the advantages of a 1D-CNN bandpass filter in extracting quasi-biweekly-to-intraseasonal signals (10–60 days) from temperature data provided by the Hong Kong Observatory. The results show that the 1D-CNN achieves accuracies similar to a 121-point Lanczos filter. In addition, the 1D-CNN filter allows a maximum of 10 missing data points within the 60-point window length, while keeping its accuracy higher than 80% (R2 > 0.8). This indicates that the 1D-CNN model works well even when missing data points exist in the time series. This study highlights another potential for applying machine learning algorithms in atmospheric and climate research, which will be useful for future research involving incomplete time series and real-time filtering.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Meteorological Phenomena and Simulations · Climate variability and models · Hydrological Forecasting Using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Data Science, City University of Macau, Macau 999078, China

Guangzhou Institute of Tropical and Marine Meteorology/Guangdong Provincial Key Laboratory of Regional Numerical Weather Prediction, China Meteorological Administration, Guangzhou 510000, China

Hong Kong Observatory, 134A Nathan Road, Kowloon, Hong Kong, China

ESCAP/WMO Typhoon Committee Secretariat, Macau 999078, China

Japan Agency for Marine-Earth Science and Technology, Kanazawa District, Yokohama 236-0001, Japan

College of Meteorology and Oceanography, National University of Defense Technology, Changsha 410073, China

College of Atmospheric Sciences, Lanzhou University, Lanzhou 730000, China

Funding

Japan Society for the Promotion of Science · Great Britain Sasakawa Foundation · Guangdong Basic and Applied Basic Research Foundation · Guangdong Province Introduction of Innovative R&D Team Project

References (46)

Show source-provided references
1. Wang, B., Ding, Y., and Sikka, D. (2006). Synoptic systems and weather. The Asian Monsoon, Springer.10.1007/3-540-37722-0 ↗
2. Synoptic climatology and the general circulation model10.1177/0309133309357012 ↗
3. Anomaly based synoptic analysis and model prediction of six dust storms moving from Mongolia to northern China in spring 202110.1029/2021JD036272 ↗
4. A climatology of daily synoptic circulation patterns and associated surface meteorology over southern South America10.1007/s00382-019-04768-3 ↗
5. Changing lengths of the four seasons by global warming10.1029/2020GL091753 ↗
6. Weakening seasonality of Indo-Pacific warm pool size in a warming world since 195010.1088/1748-9326/acabd5 ↗
7. Human influence on the seasonal cycle of tropospheric temperature10.1126/science.aas8806 ↗
8. Revisiting the Seasonal Cycle of Rainfall over Central Africa10.1175/JCLI-D-23-0281.1 ↗
9. Changing El Niño–Southern oscillation in a warming climate10.1038/s43017-021-00199-z ↗
10. A new picture of the global impacts of El Nino-Southern oscillation10.1038/s41598-019-54090-5 ↗
11. ENSO and greenhouse warming10.1038/nclimate2743 ↗
12. El Niño and health in an era of unprecedented climate change10.1016/S0140-6736(23)01664-1 ↗
13. Madden–Julian oscillation: Bridging weather and climate10.1175/BAMS-D-12-00026.1 ↗
14. Intraseasonal variability of global land monsoon precipitation and its recent trend10.1038/s41612-022-00253-7 ↗
15. Monitoring the Madden–Julian oscillation with geopotential height10.1007/s00382-016-3431-x ↗
16. Madden-julian oscillation10.1029/2004RG000158 ↗
17. Trend and interannual variability of Walker, monsoon and Hadley circulations defined by velocity potential in the upper troposphere10.3402/tellusa.v56i3.14410 ↗
18. Recent weakening relationship between the springtime Indo-Pacific warm pool SST zonal gradient and the subsequent summertime western Pacific subtropical high10.1002/joc.7890 ↗
19. Temperature and precipitation variability in regional climate models and driving global climate models: Total variance and its temporal-scale components10.1002/joc.5876 ↗
20. Short-period solar cycle signals in the ionosphere observed by FORMOSAT-3/COSMIC10.1029/2008GL034433 ↗
21. Development of a time-domain, variable-period surface-wave magnitude measurement procedure for application at regional and teleseismic distances, part I: Theory10.1785/0120050055 ↗
22. Lanczos filtering in one and two dimensions10.1175/1520-0450(1979)018<1016:LFIOAT>2.0.CO;2 ↗
23. Zhang, J., Wang, H., and Liu, F. (2019). Inter-annual variability of boreal summer intra-seasonal oscillation propagation from the Indian ocean to the Western Pacific. Atmosphere, 10.10.3390/atmos10100596 ↗
24. Influence of Indian Ocean Dipole on boreal summer intraseasonal oscillations in a coupled general circulation model10.1029/2008JD011096 ↗
25. Detection of the MJO signal from QuikSCAT10.1175/JTECH1822.1 ↗
26. Geopotential-based Multivariate MJO Index: Extending RMM-like indices to pre-satellite era10.1007/s00382-022-06142-2 ↗
27. Quasi-biweekly oscillations in the Bay of Bengal in observations and model simulations10.1016/j.dsr2.2019.06.017 ↗
28. Quasi-biweekly oscillation of the South Asian high and its role in connecting the Indian and East Asian summer rainfalls10.1029/2019GL086180 ↗
29. Tong, Q., and Yao, S. (2018). The quasi-biweekly oscillation of winter precipitation associated with enso over southern China. Atmosphere, 9.10.3390/atmos9100406 ↗
30. Origins of quasi-biweekly and intraseasonal oscillations over the South China Sea and Bay of Bengal and scale selection of unstable equatorial and off-equatorial modes10.1007/s13351-020-9109-7 ↗
31. Quasi-biweekly oscillation of the Asian monsoon rainfall in late summer and autumn: Different types of structure and propagation10.1007/s00382-019-04946-3 ↗
32. Abrupt shift of the ITCZ over West Africa and intra-seasonal variability10.1029/1999GL011285 ↗
33. Analyzing abrupt and nonlinear climate changes and their impacts10.1002/wcc.130 ↗
34. A deep learning filter for the intraseasonal variability of the tropics
35. Monthly rainfall forecasting using one-dimensional deep convolutional neural network10.1109/ACCESS.2018.2880044 ↗
36. Sari, Y.R., Djamal, E.C., and Nugraha, F. (2020, January 15–16). Daily rainfall prediction using one dimensional convolutional neural networks. Proceedings of the 2020 3rd International Conference on Computer and Informatics Engineering (IC2IE), Yogyakarta, Indonesia.10.1109/IC2IE50715.2020.9274572 ↗
37. Modulations of Madden–Julian Oscillation and Quasi-Biweekly Oscillation on Early Summer Tropical Cyclone Genesis over the Bay of Bengal and South China Sea10.1175/JCLI-D-23-0376.1 ↗
38. Significance tests for the wavelet power and the wavelet power spectrum10.5194/angeo-25-2259-2007 ↗
39. Characteristics and origin of quasi-biweekly oscillation over the western North Pacific during boreal summer
40. Investigating the origins and significance of low-frequency modes of climate variability10.1029/94GL00978 ↗
41. On the power spectrum of “red noise”10.1175/1520-0469(1963)020<0182:OTPSON>2.0.CO;2 ↗
42. Taquet, J., and Labit, C. (2010, January 4–6). Optimized decomposition basis using Lanczos filters for lossless compression of biomedical images. Proceedings of the 2010 IEEE International Workshop on Multimedia Signal Processing, Saint-Malo, France.10.1109/MMSP.2010.5662005 ↗
43. Subjective MSE measures10.1109/TSMC.1986.4308985 ↗
44. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance10.3354/cr030079 ↗
45. Correlation and the coefficient of determination10.1037/0033-2909.97.2.307 ↗
46. Haltiner, G.J. (1971). Numerical Weather Prediction, John Wiley and Sons.