journal article·2020-03-12Open access

Urban PM2.5 Concentration Prediction via Attention-Based CNN–LSTM

Songzhou Li, Gang Xie, Jinchang Ren, Lei Guo, Yunyun Yang, Xinying Xu

Applied Sciences· Volume 10· Issue 6

Abstract

Urban particulate matter forecasting is regarded as an essential issue for early warning and control management of air pollution, especially fine particulate matter (PM2.5). However, existing methods for PM2.5 concentration prediction neglect the effects of featured states at different times in the past on future PM2.5 concentration, and most fail to effectively simulate the temporal and spatial dependencies of PM2.5 concentration at the same time. With this consideration, we propose a deep learning-based method, AC-LSTM, which comprises a one-dimensional convolutional neural network (CNN), long short-term memory (LSTM) network, and attention-based network, for urban PM2.5 concentration prediction. Instead of only using air pollutant concentrations, we also add meteorological data and the PM2.5 concentrations of adjacent air quality monitoring stations as the input to our AC-LSTM. Hence, the spatiotemporal correlation and interdependence of multivariate air quality-related time-series data are learned by the CNN–LSTM network in AC-LSTM. The attention mechanism is applied to capture the importance degrees of the effects of featured states at different times in the past on future PM2.5 concentration. The attention-based layer can automatically weigh the past feature states to improve prediction accuracy. In addition, we predict the PM2.5 concentrations over the next 24 h by using air quality data in Taiyuan city, China, and compare it with six baseline methods. To compare the overall performance of each method, the mean absolute error (MAE), root-mean-square error (RMSE), and coefficient of determination (R2) are applied to the experiments in this paper. The experimental results indicate that our method is capable of dealing with PM2.5 concentration prediction with the highest performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Air Quality Monitoring and Forecasting · Air Quality and Health Impacts · Vehicle emissions and performance

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan 030024, China

Shanxi Key Laboratory of Advanced Control and Intelligent Information System, Taiyuan 030024, China

School of Electronic Information Engineering, Taiyuan University of Science and Technology, Taiyuan 030024, China

Department of Electronic and Electrical Engineering, University of Strathclyde, Glasgow G11XW, UK

College of Information and Computer, Taiyuan University of Technology, Taiyuan 030024, China

Funding

Shanxi International Cooperation Project · Key Research and Development Plan of Shanxi Province · The Hundreds Talent Programe of Shanxi Province, China.

References (28)

Show source-provided references
1. Forecasting air pollutant indicator levels with geographic models 3 days in advance using neural networks10.1016/j.eswa.2010.05.093 ↗
2. Du, S., Li, T., Yang, Y., and Horng, S.J. (2018). Deep Air Quality Forecasting Using Hybrid Deep Learning Framework. arXiv.10.1109/ISKE.2017.8258813 ↗
3. Spatiotemporal distribution of indoor particulate matter concentration with a low-cost sensor network10.1016/j.buildenv.2017.11.001 ↗
4. Air pollution in China: Status and spatiotemporal variations10.1016/j.envpol.2017.04.075 ↗
5. Zheng, Y., Liu, F., and Hsieh, H.P. (2013, January 11–14). U-air: When urban air quality inference meets big data. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.10.1145/2487575.2488188 ↗
6. Prediction of PM2.5 concentration based on the similarity in air quality monitoring network10.1016/j.buildenv.2018.03.058 ↗
7. Long short-term memory neural network for traffic speed prediction using remote microwave sensor data10.1016/j.trc.2015.03.014 ↗
8. Dynamically pre-trained deep recurrent neural networks using environmental monitoring data for predicting PM2.510.1007/s00521-015-1955-3 ↗
9. Recurrent Neural Network and random forest for analysis and accurate forecast of atmospheric pollutants: A case study in Hangzhou, China10.1016/j.jclepro.2019.05.319 ↗
10. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
11. (2014, June 24). Recurrent models of visual attention. Available online: https://arxiv.org/abs/1406.6247.
12. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
13. Rush, A.M., Chopra, S., and Weston, J. (2015). A neural attention model for abstractive sentence summarization. arXiv.10.18653/v1/D15-1044 ↗
14. Measurements of PM10 and PM2.5 particle concentrations in Athens, Greece10.1016/S1352-2310(02)00898-1 ↗
15. Meteorological dependence of size-fractionated number concentrations of urban aerosol particles10.1016/j.atmosenv.2005.10.061 ↗
16. Seasonal modeling of PM2.5, in California’s San Joaquin Valley10.1016/j.atmosenv.2014.04.030 ↗
17. Multifractal detrended cross-correlation analysis between PM2.5 and meteorological factors10.1016/j.physa.2015.06.039 ↗
18. Estimation of the building energy use intensity in the urban scale by integrating GIS and big data technology10.1016/j.apenergy.2016.08.079 ↗
19. Methods for imputation of missing values in air quality data sets10.1016/j.atmosenv.2004.02.026 ↗
20. Notes on Regression and Inheritance in the Case of Two Parents10.1098/rspl.1895.0041 ↗
21. Box, G.E.P., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, John Wiley & Sons.
22. Imagenet classification with deep convolutional neural networks
23. Soft detection of 5-day BOD with sparse matrix in city harbor water using deep learning techniques10.1016/j.watres.2019.115350 ↗
24. Effective long short-term memory with differential evolution algorithm for electricity price prediction10.1016/j.energy.2018.05.052 ↗
25. Saian, R., and Abbas, M.A. (2018). Evaluating Fuzzy Time Series and Artificial Neural Network for Air Pollution Index Forecasting. Proceedings of the Second International Conference on the Future of ASEAN (ICoFA) 2017—Volume 2, Springer.10.1007/978-981-10-8471-3 ↗
26. A Wavelet-based Neural Network Model to Predict Ambient Air Pollutants’ Concentration10.1007/s10666-011-9270-6 ↗
27. Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation10.1016/j.envpol.2017.08.114 ↗
28. Huang, C.J., and Kuo, P.H. (2018). A deep cnn-lstm model for particulate matter (PM2.5) forecasting in smart cities. Sensors, 18.10.3390/s18072220 ↗