An Attention-Based CNN-LSTM Method for Effluent Wastewater Quality Prediction
Source abstract
Abstract
Wastewater treatment is a pivotal step in water resource recycling. Predicting effluent wastewater quality can help wastewater treatment plants (WWTPs) establish efficient operations so as to save resources. We propose CNN-LSTM-Attention (CLATT), an attention-based effluent wastewater quality prediction model, which uses a convolutional neural network (CNN) as an encoder and a long short-term memory network (LSTM) as a decoder. An attention mechanism is used to aggregate the information at adjacent sampling times. A sliding window method is proposed to solve the problem of the prediction performance of the model decreasing with time. We conducted the experiment using data collected from a WWTP in Fujian, China. Our results show that the accuracy of prediction is improved, with MSE decreasing by 0.25, MAPE decreasing by 5% and LER decreasing by 7%, after using the sliding window method. Compared with other methods, CLATT achieves the fastest prediction speed among all the methods based on LSTM and the most accurate prediction performance, with MSE increasing up to 0.92, MAPE up to 0.08 and LER up to 0.11. Furthermore, we performed an ablation study on the proposed method to validate the rationality of the major part of the model, and the results show that the LSTM significantly improves the predictive performance of the model, and the CNN and the attention mechanism also improve the accuracy of the prediction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Water Quality Monitoring Technologies · Hydrological Forecasting Using AI · Machine Learning and ELM
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
Science Island Branch, Graduate School of USTC, Hefei 230026, China
Funding
AIWater (Anhui) Co., Ltd.
References (25)
Show source-provided references
1. Cost-efficient operation of a denitrifying activated sludge process10.1016/j.watres.2006.10.031 ↗
2. Optimization of a sequencing batch reactor for biological nitrogen removal10.1016/S0043-1354(00)00010-5 ↗
3. Activated sludge model no. 310.2166/wst.1999.0039 ↗
4. New mathematical procedure for the automatic estimation of influent characteristics in WWTPs10.2166/wst.2007.603 ↗
5. A new statistical framework for parameter subset selection and optimal parameter estimation in the activated sludge model10.1016/j.jhazmat.2010.07.044 ↗
6. Artifificial neural networks modeling for predicting treatment effificiency and considering effects of input parameters in prediction accuracy: A case study in tabriz treatment plant
7. Wastewater treatment plant performance analysis using artifificial intelligence—An ensemble approach10.2166/wst.2018.477 ↗
8. A machine learning framework to improve effluent quality control in wastewater treatment plants10.1016/j.scitotenv.2021.147138 ↗
9. Zhang, L., Ma, X., Shi, P., Bi, S., and Wang, C. (2019, January 4–6). RegCNN: A Deep Multi-output Regression Method for Wastewater Treatment. Proceedings of the IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), Portland, OR, USA.10.1109/ICTAI.2019.00117 ↗
10. Application of novel hybrid deep leaning model for cleaner production in a paper industrial wastewater treatment system10.1016/j.jclepro.2021.126343 ↗
11. Jafar, R., Awad, A., Jafar, K., and Shahrour, I. (2022). Predicting Effluent Quality in Full-Scale Wastewater Treatment Plants Using Shallow and Deep Artificial Neural Networks. Sustainability, 14.10.2139/ssrn.4059021 ↗
12. Water quality prediction model using Gaussian process regression based on deep learning for carbon neutrality in papermaking wastewater treatment system10.1016/j.envres.2022.112942 ↗
13. Wang, X.F., Wei, S.N., Xu, L.X., Pan, J., Wu, Z.Z., Kwong, T.C., and Tang, Y.Y. (2021, January 4–5). LSTM Wastewater Quality Prediction Based on Attention Mechanism. Proceedings of the International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR), Adelaide, Australia.10.1109/ICWAPR54887.2021.9736154 ↗
14. Srinivasan, S., Ravi, V., Sowmya, V., Krichen, M., Noureddine, D.B., Anivilla, S., and Soman, K.P. (2020, January 4–5). Deep Convolutional Neural Network Based Image Spam Classification. Proceedings of the Conference on Data Science and Machine Learning Applications (CDMA), Riyadh, Saudi Arabia.10.1109/CDMA47397.2020.00025 ↗
15. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
16. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
17. Tzirakis, P., Zhang, J., and Schuller, B.W. (2018, January 15–20). End-to-End Speech Emotion Recognition Using Deep Neural Networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8462677 ↗
18. Breuel, T.M. (2017, January 9–15). High-Performance Text Recognition Using a Hybrid Convolutional-LSTM Implementation. Proceedings of the IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.12 ↗
19. Pielka, M., Sifa, R., Hillebrand, L.P., Biesner, D., Ramamurthy, R., Ladi, A., and Bauckhage, C. (2021, January 10–15). Tackling Contradiction Detection in German Using Machine Translation and End-to-End Recurrent Neural Networks. Proceedings of the International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9413257 ↗
20. An on-line wastewater quality prediction system based on a time-delay neural network10.1016/S0952-1976(98)00017-7 ↗
21. Short-term electricity load and price forecasting by a new optimal LSTM-NN based prediction algorithm10.1016/j.epsr.2020.106995 ↗
22. Mnih, V., Heess, N., Graves, A., and Kavukcuoglu, K. Recurrent models of visual attention. Proceedings of the 27th International Conference on Neural Information Processing Systems—Volume 2 (NIPS’14).
23. Tabelini, L., Berriel, R., Paixao, T.M., Badue, C., De Souza, A.F., and Oliveira-Santos, T. (2021, January 20–25). Keep your Eyes on the Lane: Real-time Attention-guided Lane Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00036 ↗
24. A short-term load forecasting model of multi-scale CNN-LSTM hybrid neural network considering the real-time electricity price10.1016/j.egyr.2020.11.078 ↗
25. Huang, S., Shen, J., Lv, Q., Zhou, Q., and Yong, B. (2023). A Novel NODE Approach Combined with LSTM for Short-Term Electricity Load Forecasting. Future Internet, 15.10.3390/fi15010022 ↗