journal article·2022-11-03Open access

Forecasting of PM2.5 Concentration in Beijing Using Hybrid Deep Learning Framework Based on Attention Mechanism

Dong Li, Jiping Liu, Yangyang Zhao

Applied Sciences· Volume 12· Issue 21

Abstract

Air pollution has become a critical factor affecting the health of human beings. Forecasting the trend of air pollutants will be of considerable help to public health, including improving early-warning systems. The article designs a novel hybrid deep learning framework FPHFA (FPHFA is the abbreviation of the title of this paper) for PM2.5 concentration forecasting is proposed, which learns spatially correlated features and long-term dependencies of time series data related to PM2.5. Owing to the complex nonlinear dynamic and spatial features of pollutant data, the FPHFFA model combines multi-channel one-dimensional convolutional neural networks, bi-directional long short-term memory neural networks, and attention mechanisms for the first time. Multi-channel 1D CNNs are applied to capture trend features between some sites and overall spatial characteristics of PM2.5 concentration, Bi LSTMs are used to learn the temporal correlation of PM2.5 concentration, and the attention mechanism is used to focus more effective information at different moments. We carried out experimental evaluations using the Beijing dataset, and the outcomes show that our proposed model can effectively handle PM2.5 concentration prediction with satisfactory accuracy. For the prediction task from 1 to 12 h, our proposed prediction model performs well. The FPHFA also achieves satisfactory results for prediction tasks from 13 to 96 h.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Air Quality Monitoring and Forecasting · Air Quality and Health Impacts · COVID-19 impact on air quality

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Geomatics, Lanzhou Jiaotong University, Lanzhou 730070, China

Chinese Academy of Surveying and Mapping, Beijing 100830, China

National-Local Joint Engineering Research Center of Technologies and Applications for National Geographic State Monitoring, Lanzhou 730070, China

Gansu Provincial Engineering Laboratory for National Geographic State Monitoring, Lanzhou 730070, China

Funding

Lanzhou Jiaotong University

References (41)

Show source-provided references
1. Deep Air Quality Forecasting Using Hybrid Deep Learning Framework10.1109/TKDE.2019.2954510 ↗
2. A novel Encoder-Decoder model based on read-first LSTM for air pollutant prediction10.1016/j.scitotenv.2020.144507 ↗
3. Cost of economic growth: Air pollution and health expenditure10.1016/j.scitotenv.2020.142543 ↗
4. Spatial-temporal characteristics and determinants of PM2.5 in the Bohai Rim Urban Agglomeration10.1016/j.chemosphere.2015.12.118 ↗
5. Elman-Based Forecaster Integrated by AdaboostAlgorithm in 15 min and 24 h ahead Power OutputPrediction Using PM 2.5 Values, PV ModuleTemperature, Hours of Sunshine, and Meteorological Data10.15244/pjoes/89539 ↗
6. Prediction of hourly ground-level PM2.5 concentrations 3 days in advance using neural networks with satellite data in eastern China10.1016/j.apr.2017.04.002 ↗
7. PM2.5 analog forecast and Kalman filter post-processing for the Community Multiscale Air Quality (CMAQ) model10.1016/j.atmosenv.2015.02.021 ↗
8. Zhu, B., Akimoto, H., and Wang, Z.J.A.G.U. (2005). The Preliminary Application of a Nested Air Quality Prediction Modeling System in Kanto Area, Japan. AGU Fall Meeting Abstracts, American Geophysical Union.
9. Forecasting urban PM10 and PM2.5 pollution episodes in very stable nocturnal conditions and complex terrain using WRF–Chem CO tracer model10.1016/j.atmosenv.2011.02.001 ↗
10. Evaluation and intercomparison of ozone and PM10 simulations by several chemistry transport models over four European cities within the CityDelta project10.1016/j.atmosenv.2006.07.039 ↗
11. RCL-Learning: ResNet and convolutional long short-term memory-based spatiotemporal air pollutant concentration prediction model10.1016/j.eswa.2022.118017 ↗
12. Evolving Differential evolution method with random forest for prediction of Air Pollution10.1016/j.procs.2018.05.094 ↗
13. Forecasting of PM 10 time series using wavelet analysis and wavelet-ARMA model in Taiyuan, China10.1080/10962247.2017.1292968 ↗
14. Prediction of air pollution index (API) using support vector machine (SVM)10.1016/j.jece.2019.103208 ↗
15. Yu, Z., Yi, X., Ming, L., Li, R., and Shan, Z. (2015, January 10–13). Forecasting Fine-Grained Air Quality Based on Big Data. Proceedings of the 21th ACM SIGKDD International Conference, Sydney, Australia.
16. Highly Efficient Picture-Based Prediction of PM2.5 Concentration10.1109/TIE.2018.2840515 ↗
17. News Text Classification Based on CNLSTM Model with Attention Mechanism
18. Jan, F., Shah, I., and Ali, S. (2022). Short-Term Electricity Prices Forecasting Using Functional Time Series Analysis. Energies, 15.10.3390/en15093423 ↗
19. A novel prediction model of PM2.5 mass concentration based on back propagation neural network algorithm10.3233/JIFS-179119 ↗
20. Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks10.1016/j.jsv.2016.10.043 ↗
21. An Air Quality Predictive Model of Licang of Qingdao City Based on BP Neural Network10.4028/www.scientific.net/AMR.756-759.3366 ↗
22. A Spatiotemporal Prediction Framework for Air Pollution Based on Deep RNN
23. Chung, J., Gulcehre, C., Cho, K.H., and Bengio, Y. (2014). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv.
24. Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation10.1016/j.envpol.2017.08.114 ↗
25. Prihatno, A.T., Nurcahyanto, H., Ahmed, M.F., Rahman, M.H., Alam, M.M., and Jang, Y.M. (2021). Forecasting PM2.5 Concentration Using a Single-Dense Layer BiLSTM Method. Electronics, 10.10.3390/electronics10151808 ↗
26. Multi-hour and multi-site air quality index forecasting in Beijing using CNN, LSTM, CNN-LSTM, and spatiotemporal clustering10.1016/j.eswa.2020.114513 ↗
27. Long short-term memory—Fully connected (LSTM-FC) neural network for PM 2.5 concentration prediction10.1016/j.chemosphere.2018.12.128 ↗
28. Huang, C.J., and Kuo, P.H. (2018). A Deep CNN-LSTM Model for Particulate Matter (PM2.5) Forecasting in Smart Cities. Sensors, 18.10.3390/s18072220 ↗
29. Li, S., Xie, G., Ren, J., Guo, L., and Xu, X. (2020). Urban PM2.5 Concentration Prediction via Attention-Based CNN–LSTM. Appl. Sci., 10.10.3390/app10061953 ↗
30. A hybrid model for PM2.5 forecasting based on ensemble empirical mode decomposition and a general regression neural network10.1016/j.scitotenv.2014.07.051 ↗
31. FDN-learning: Urban PM 2.5-concentration Spatial Correlation Prediction Model Based on Fusion Deep Neural Network10.1016/j.bdr.2021.100269 ↗
32. ImageNet Classification with Deep Convolutional Neural Networks
33. Bidirectional recurrent neural networks10.1109/78.650093 ↗
34. Predicting annual PM2.5 in mainland China from 2014 to 2020 using multi temporal satellite product: An improved deep learning approach with spatial generalization ability10.1016/j.isprsjprs.2022.03.002 ↗
35. Yang, Q., Yuan, Q., Li, T., Shen, H., and Zhang, L. (2017). The relationships between PM2.5 and meteorological factors in China: Seasonal and regional variations. Int. J. Environ. Res. Public Health, 12.10.3390/ijerph14121510 ↗
36. PM 2.5 concentrations forecasting in Beijing through deep learning with different inputs, model structures and forecast time10.1016/j.apr.2021.101168 ↗
37. The air pollution caused by the burning of fireworks during the lantern festival in Beijing10.1016/j.atmosenv.2006.07.043 ↗
38. Analysis of Spatial-temporal Distribution Characteristics and Main Cause of Air Pollution in Beijing-Tianjin-Hebei Region in 2014
39. Temporal and spatial trends in air quality in Beijing10.1016/j.landurbplan.2019.01.006 ↗
40. Study on the spatial distribution characteristics and the drivers of AQI in North China
41. Spatio-temporal modeling and prediction of PM_(2.5) concentration based on Bayesian method