An Improved TCN-BiGRU Architecture with Dual Attention Mechanisms for Spatiotemporal Simulation Systems: Application to Air Pollution Prediction
Source abstract
Abstract
Long-term and accurate prediction of air pollutant concentrations can serve as a foundation for air pollution warning and prevention, which is crucial for social development and human health. In this study, we provide a model for predicting the concentration of air pollutants based on big data spatiotemporal correlation analysis and deep learning methods. Based on an improved temporal convolutional network (TCN) and a bi-directional gated recurrent unit (BiGRU) as the fundamental architecture, the model adds two attention mechanisms to improve performance: Squeeze and Excitation Networks (SENet) and Convolutional Block Attention Module (CBAM). The improved TCN moves the residual connection layer to the network’s front end as a preprocessing procedure, improving the model’s performance and operating efficiency, particularly for big data jobs like air pollution concentration prediction. The use of SENet improves the model’s comprehension and extraction of long-term dependent features from pollutants and meteorological data. The incorporation of CBAM enhances the model’s perception ability towards key local regions through an attention mechanism in the spatial dimension of the feature map. The TCN-SENet-BiGRU-CBAM model successfully realizes the prediction of air pollutant concentrations by extracting the spatiotemporal features of the data. Compared with previous advanced deep learning models, the model has higher prediction accuracy and generalization ability. The model is suitable for prediction tasks from 1 to 12 h in the future, with root mean square error (RMSE) and mean absolute error (MAE) ranging from 5.309~14.043 and 3.507~9.200, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Air Quality Monitoring and Forecasting · Traffic Prediction and Management Techniques · Solar Radiation and Photovoltaics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 102616, China
Funding
National Natural Science Foundation of China · R & D Program of Beijing Municipal Education Commission
References (43)
Show source-provided references
1. A novel spatiotemporal multigraph convolutional network for air pollution prediction10.1007/s10489-022-04418-y ↗
2. Science-policy interplay on air pollution governance in China10.1016/j.envsci.2020.03.003 ↗
3. The state of science on severe air pollution episodes: Quantitative and qualitative analysis10.1016/j.envint.2021.106732 ↗
4. Large scale air pollution prediction with deep convolutional networks10.1007/s11432-020-2951-1 ↗
5. Hybrid interpretable predictive machine learning model for air pollution prediction10.1016/j.neucom.2021.09.051 ↗
6. Air-pollution prediction in smart city, deep learning approach10.1186/s40537-021-00548-1 ↗
7. A systematic survey of air quality prediction based on deep learning10.1016/j.aej.2024.03.031 ↗
8. Multi-scale analysis of the impacts of meteorology and emissions on PM2.5 and O3 trends at various regions in China from 2013 to 2020 2. Key weather elements and emissions10.1016/j.scitotenv.2022.153847 ↗
9. Spatio-temporal joint modelling on moderate and extreme air pollution in Spain10.1007/s10651-023-00575-6 ↗
10. Lalik, K., Kozak, J., Podlasek, S., and Kozek, M. (2022). Self-powered wireless sensor matrix for air pollution detection with a neural predictor. Energies, 15.10.3390/en15061962 ↗
11. Machine learning-based Decision Tree J48 with grey wolf optimizer for environmental pollution control10.1080/09593330.2021.2017491 ↗
12. Niu, C., Niu, Z., Qu, Z., Wei, L., and Li, Y. (2022). Research and application of the mode decomposition-recombination technique based on sample-fuzzy entropy and K-means for air pollution forecasting. Front. Environ. Sci., 10.10.3389/fenvs.2022.941405 ↗
13. Meteorological pattern analysis assisted daily PM2.5 grades prediction using SVM optimized by PSO algorithm10.1016/j.apr.2019.04.005 ↗
14. Yang, J., Tian, Y., and Wu, C.H. (2024). Air Quality Prediction and Ranking Assessment Based on Bootstrap-XGBoost Algorithm and Ordinal Classification Models. Atmosphere, 15.10.3390/atmos15080925 ↗
15. Investigation of model ensemble for fine-grained air quality prediction10.23919/J.CC.2020.07.015 ↗
16. Pan, K., Lu, J., Li, J., and Xu, Z. (2023). A Hybrid Autoformer Network for Air Pollution Forecasting Based on External Factor Optimization. Atmosphere, 14.10.3390/atmos14050869 ↗
17. Deep learning-based air pollution analysis on carbon monoxide in Taiwan10.1016/j.ecoinf.2024.102477 ↗
18. Ragab, M.G., Abdulkadir, S.J., Aziz, N., Al-Tashi, Q., Alyousifi, Y., and Alhussian, H. (2020). A Novel One-Dimensional CNN with Exponential Adaptive Gradients for Air Pollution Index Prediction. Sustainability, 12.10.3390/su122310090 ↗
19. An LSTM-based aggregated model for air pollution forecasting10.1016/j.apr.2020.05.015 ↗
20. Saif-ul-Allah, M.W., Qyyum, M.A., Ul-Haq, N., Salman, C.A., and Ahmed, F. (2022). Gated recurrent unit coupled with projection to model plane imputation for the PM2.5 prediction for Guangzhou City, China. Front. Environ. Sci., 9.10.3389/fenvs.2021.816616 ↗
21. Multi-output TCN autoencoder for long-term pollution forecasting for multiple sites10.1016/j.uclim.2021.100943 ↗
22. A spatial correlation prediction model of urban PM2.5 concentration based on deconvolution and LSTM10.1016/j.neucom.2023.126280 ↗
23. Zhu, X., Zou, F., and Li, S. (2024). Enhancing Air Quality Prediction with an Adaptive PSO-Optimized CNN-Bi-LSTM Model. Appl. Sci., 14.10.3390/app14135787 ↗
24. An integrated 3D CNN-GRU deep learning method for short-term prediction of PM2.5 concentration in urban environment10.1016/j.scitotenv.2022.155324 ↗
25. RCL-Learning: ResNet and convolutional long short-term memory-based spatiotemporal air pollutant concentration prediction model10.1016/j.eswa.2022.118017 ↗
26. Chen, C., Qiu, A., Chen, H., Chen, Y., Liu, X., and Li, D. (2023). Prediction of pollutant concentration based on spatial–temporal attention, ResNet and ConvLSTM. Sensors, 23.10.3390/s23218863 ↗
27. Li, D., Liu, J., and Zhao, Y. (2022). Prediction of multi-site PM2.5 concentrations in Beijing using CNN-Bi LSTM with CBAM. Atmosphere, 13.10.3390/atmos13101719 ↗
28. Residual neural network with spatiotemporal attention integrated with temporal self-attention based on long short-term memory network for air pollutant concentration prediction10.1016/j.atmosenv.2024.120531 ↗
29. Estimation of the PM2.5 health effects in China during 2000–2011. Environ10.1007/s11356-017-8673-6 ↗
30. Multi-hour and multi-site air quality index forecasting in Beijing using CNN, LSTM, CNN-LSTM, and spatiotemporal clustering10.1016/j.eswa.2020.114513 ↗
31. A novel Encoder-Decoder model based on read-first LSTM for air pollutant prediction10.1016/j.scitotenv.2020.144507 ↗
32. Spatial and temporal variability of PM2.5 and PM10 over the North China Plain and the Yangtze River Delta, China10.1016/j.atmosenv.2014.07.019 ↗
33. Deep learning coupled model based on TCN-LSTM for particulate matter concentration prediction10.1016/j.apr.2023.101703 ↗
34. Development of continuous cuffless blood pressure prediction platform using enhanced 1-D SENet-LSTM10.1016/j.eswa.2023.122812 ↗
35. An optimized decomposition integration model for deterministic and probabilistic air pollutant concentration prediction considering influencing factors10.1016/j.apr.2024.102144 ↗
36. Using a deep convolutional neural network to predict 2017 ozone concentrations, 24 hours in advance10.1016/j.neunet.2019.09.033 ↗
37. Long short-term memory neural network for air pollutant concentration predictions: Method development and evaluation10.1016/j.envpol.2017.08.114 ↗
38. Short-term prediction of PM2.5 pollution with deep learning methods
39. Huang, J., Liu, S., Hassan, S.G., and Xu, L. (2021). Pollution index of waterfowl farm assessment and prediction based on temporal convoluted network. PLoS ONE, 16.10.1371/journal.pone.0254179 ↗
40. A hybrid CNN-LSTM model for forecasting particulate matter (PM2.5)10.1109/ACCESS.2020.2971348 ↗
41. Spatially resolved air quality index prediction in megacities with a CNN-Bi-LSTM hybrid framework10.1016/j.scs.2024.105537 ↗
42. Application of TCN-biGRU neural network in PM2.5 concentration prediction10.1007/s11356-023-30354-6 ↗
43. Multi-step forecast of PM2.5 and PM10 concentrations using convolutional neural network integrated with spatial-temporal attention and residual learning10.1016/j.envint.2022.107691 ↗