Relevance of Machine Learning Techniques in Water Infrastructure Integrity and Quality: A Review Powered by Natural Language Processing
Source abstract
Abstract
Water infrastructure integrity, quality, and distribution are fundamental for public health, environmental sustainability, economic development, and climate change resilience. Ensuring the robustness and quality of water infrastructure is pivotal for sectors like agriculture, industry, and energy production. Machine learning (ML) offers potential for bolstering water infrastructure integrity and quality by analyzing extensive data from sensors and other sources, optimizing treatment protocols, minimizing water losses, and improving distribution methods. This study delves into ML applications in water infrastructure integrity and quality by analyzing English-language articles from 2015 onward, compiling a total of 1087 articles. Initially, a natural language processing approach centered on topic modeling was adopted to classify salient topics. From each identified topic, key terms were extracted and utilized in a semi-automatic selection process, pinpointing the most relevant articles for further scrutiny, while unsupervised ML algorithms can assist in extracting themes from the documents, generating meaningful topics often requires intricate hyperparameter adjustments. Leveraging the Bidirectional Encoder Representations from Transformers (BERTopic) enhanced the study’s contextual comprehension in topic modeling. This semi-automatic methodology for bibliographic exploration begins with a broad topic categorization, advancing to an exhaustive analysis of each topic. The insights drawn underscore ML’s instrumental role in enhancing water infrastructure’s integrity and quality, suggesting promising future research directions. Specifically, the study has identified four key areas where ML has been applied to water management: (1) advancements in the detection of water contaminants and soil erosion; (2) forecasting of water levels; (3) advanced techniques for leak detection in water networks; and (4) evaluation of water quality and potability. These findings underscore the transformative impact of ML on water infrastructure and suggest promising paths for continued investigation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hydrological Forecasting Using AI · Water Quality Monitoring Technologies · Water Systems and Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Escuela de Ingeniería de Construcción y Transporte, Pontificia Universidad Católica de Valparaíso, Valparaíso 2362804, Chile
Facultad de Ingeniería, Centro de Transformación Digital, Universidad del Desarrollo, Santiago 7610658, Chile
Institute of Concrete Science and Technology (ICITECH), Universitat Politècnica de València, 46022 València, Spain
References (99)
Show source-provided references
1. Wastewater irrigation and environmental health: Implications for water governance and public policy10.1016/j.ijheh.2011.10.003 ↗
2. Beneath the surface of global change: Impacts of climate change on groundwater10.1016/j.jhydrol.2011.05.002 ↗
3. Assessment of the sustainability of water resources management: A critical review of the city blueprint approach10.1007/s11269-015-1139-z ↗
4. Assessment of water policies contributions for sustainable water resources management under climate change scenarios10.1016/j.jhydrol.2022.127690 ↗
5. Investment in drinking water and sanitation infrastructure and its impact on waterborne diseases dissemination: The Brazilian case10.1016/j.scitotenv.2021.146279 ↗
6. Sustainable use and management of non-conventional water resources for rehabilitation of marginal lands in arid and semiarid environments10.1016/j.agwat.2019.04.014 ↗
7. Quantifying global agricultural water appropriation with data derived from earth observations10.1016/j.jclepro.2022.131891 ↗
8. Solar absorber material and system designs for photothermal water vaporization towards clean water and energy production10.1039/C8EE01146J ↗
9. Fresh water availability and it’s global challenge10.37745/bjmas.2022.0208 ↗
10. Agricultural communities’ risk assessment and the effects of climate change: A pathway toward green productivity and sustainable development10.3389/fenvs.2022.948016 ↗
11. Beyond water scarcity: Water (in) security and social justice in Karachi10.1016/j.ejrh.2022.101140 ↗
12. Ajith, J.B., Manimegalai, R., and Ilayaraja, V. (2020, January 24–25). An IoT based smart water quality monitoring system using cloud. Proceedings of the 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), Vellore, India.10.1109/ic-ETITE47903.2020.450 ↗
13. Groundwater Quality Analysis and Drinkability Prediction using Artificial Intelligence10.1007/s12145-023-00977-x ↗
14. A novel approach for predicting water demand with complex patterns based on ensemble learning10.1007/s11269-022-03255-5 ↗
15. Machine Learning–Assisted Model for Leak Detection in Water Distribution Networks Using Hydraulic Transient Flows10.1061/(ASCE)WR.1943-5452.0001508 ↗
16. Unsupervised learning by probabilistic latent semantic analysis10.1023/A:1007617005950 ↗
17. Latent dirichlet allocation
18. Learning the parts of objects by non-negative matrix factorization10.1038/44565 ↗
19. Arora, S., Ge, R., and Moitra, A. (2012, January 20–23). Learning topic models–going beyond SVD. Proceedings of the 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science, New Brunswick, NJ, USA.10.1109/FOCS.2012.49 ↗
20. Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv.
21. Machine learning techniques applied to construction: A hybrid bibliometric analysis of advances and future directions10.1016/j.autcon.2022.104532 ↗
22. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
23. McInnes, L., Healy, J., and Melville, J. (2018). Umap: Uniform manifold approximation and projection for dimension reduction. arXiv.10.21105/joss.00861 ↗
24. Campello, R.J., Moulavi, D., and Sander, J. (2013, January 14–17). Density-based clustering based on hierarchical density estimates. Proceedings of the Advances in Knowledge Discovery and Data Mining: 17th Pacific-Asia Conference, PAKDD 2013, Gold Coast, Australia. Proceedings, Part II 17.
25. bibliometrix: An R-tool for comprehensive science mapping analysis
26. Thematic mapping on bibliographic databases by cluster analysis: A description of the sdoc environment with solis
27. Entrepreneurship and family firm research: A bibliometric analysis of an emerging field10.1111/jsbm.12161 ↗
28. Sources of information on specific subjects
29. A comparison of multiple methods for mapping groundwater levels in the Mu Us Sandy Land, China10.1016/j.ejrh.2022.101189 ↗
30. Deep learning in remote sensing: A comprehensive review and list of resources10.1109/MGRS.2017.2762307 ↗
31. Comparison of daily streamflow forecasts using extreme learning machines and the Random Forest method10.1080/02626667.2019.1680846 ↗
32. Schütze, H., Manning, C.D., and Raghavan, P. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
33. Jurafsky, D., and Martin, J.H. (2019). Speech and Language Processing, Stanford University. [3rd ed.].
34. Large scale prediction of groundwater nitrate concentrations from spatial data using machine learning10.1016/j.scitotenv.2019.03.045 ↗
35. Assessing the performance of GIS-based machine learning models with different accuracy measures for determining susceptibility to gully erosion10.1016/j.scitotenv.2019.02.093 ↗
36. Estimating the distribution trend of soil heavy metals in mining area from HyMap airborne hyperspectral imagery based on ensemble learning10.1016/j.jhazmat.2020.123288 ↗
37. Mosavi, A., Sajedi-Hosseini, F., Choubin, B., Taromideh, F., Rahi, G., and Dineva, A.A. (2020). Susceptibility mapping of soil water erosion using machine learning models. Water, 12.10.3390/w12071995 ↗
38. Occurrence, predictors and hazards of elevated groundwater arsenic across India through field observations and regional-scale AI-based modeling10.1016/j.scitotenv.2020.143511 ↗
39. Modeling regional-scale groundwater arsenic hazard in the transboundary Ganges River Delta, India and Bangladesh: Infusing physically-based model with machine learning10.1016/j.scitotenv.2020.141107 ↗
40. Nation-wide estimation of groundwater redox conditions and nitrate concentrations through machine learning10.1088/1748-9326/ab7d5c ↗
41. Prediction of stream nitrogen and phosphorus concentrations from high-frequency sensors using Random Forests Regression10.1016/j.scitotenv.2020.143005 ↗
42. Nitrate variability in groundwater of North Carolina using monitoring and private well data models10.1021/es502725f ↗
43. Modeling groundwater nitrate exposure in private wells of North Carolina for the Agricultural Health Study10.1016/j.scitotenv.2018.11.022 ↗
44. Machine learning predictions of nitrate in groundwater used for drinking supply in the conterminous United States10.1016/j.scitotenv.2021.151065 ↗
45. Geogenic manganese and iron in groundwater of Southeast Asia and Bangladesh–Machine learning spatial prediction modeling and comparison with arsenic10.1016/j.scitotenv.2022.155131 ↗
46. Hyperspectral retrievals of suspended sediment using cluster-based machine learning regression in shallow waters10.1016/j.scitotenv.2022.155168 ↗
47. Revealing the sources of arsenic in private well water using Random Forest Classification and Regression10.1016/j.scitotenv.2022.159360 ↗
48. Detecting the sources of chemicals in the Black Sea using non-target screening and deep learning convolutional neural networks10.1016/j.scitotenv.2022.157554 ↗
49. Prediction of groundwater quality indices using machine learning algorithms10.2166/wpt.2021.120 ↗
50. Alipio, M.I. (2020, January 21–23). Data-driven IoT-based water quality monitoring and potability classification system in rural areas. Proceedings of the 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Republic of Korea.10.1109/ICTC49870.2020.9289505 ↗
51. Riyantoko, P.A., Diyasa, I.G.S.M. (2021, January 28–29). “FQAM” Feyn-QLattice Automation Modelling: Python Module of Machine Learning for Data Classification in Water Potability. Proceedings of the 2021 International Conference on Informatics, Multimedia, Cyber and Information System (ICIMCIS), Jakarta, Indonesia.10.1109/ICIMCIS53775.2021.9699371 ↗
52. Yusuf, H., Alhaddad, S., Yusuf, S., and Hewahi, N. (2022, January 25–26). Classification of Water Potability Using Machine Learning Algorithms. Proceedings of the 2022 International Conference on Data Analytics for Business and Industry (ICDABI), Sakhir, Bahrain.10.1109/ICDABI56818.2022.10041667 ↗
53. Water pollution reduction for sustainable urban development using machine learning techniques10.1016/j.cities.2022.103970 ↗
54. Rivas-Villar, D., Rouco, J., Carballeira, R., Penedo, M.G., and Novo, J. (2021). Fully automatic detection and classification of phytoplankton specimens in digital microscopy images. Comput. Methods Programs Biomed., 200.10.1016/j.cmpb.2020.105923 ↗
55. Towards developing a classification model for water potability in Philippine rural areas
56. Machine learning-based forecasting of potability of drinking water through adaptive boosting model10.1515/chem-2022-0187 ↗
57. Prediction of Quality of Water According to a Random Forest Classifier
58. Haq, M.I.K., Ramadhan, F.D., Az-Zahra, F., Kurniawati, L., and Helen, A. (2021, January 27–29). Classification of water potability using machine learning algorithms. Proceedings of the 2021 International Conference on Artificial Intelligence and Big Data Analytics, Bandung, Indonesia.
59. Predictive modeling of groundwater nitrate pollution and evaluating its main impact factors using Random Forest10.1016/j.chemosphere.2021.133388 ↗
60. Prediction of irrigation groundwater quality parameters using ANN, LSTM, and MLR models10.1007/s11356-021-17084-3 ↗
61. Monitoring water quality using proximal remote sensing technology10.1016/j.scitotenv.2021.149805 ↗
62. Real-time detection of potable-reclaimed water pipe cross-connection events by conventional water quality sensors using machine learning methods10.1016/j.jenvman.2019.02.110 ↗
63. Application and recent progress of inland water monitoring using remote sensing techniques10.1007/s10661-022-10690-9 ↗
64. Ahmed, S., Mahzabin, M., Shahpar, S., Tonni, S.I., and Rahman, M.S. (2022). Proceedings of the International Conference on Fourth Industrial Revolution and Beyond 2021, Springer.
65. Zai, C., El Mechal, C., El Amrani El Idrissi, N., and Ghennioui, H. (2022, January 28–30). Prediction of Water Quality Using Artificial Intelligence (AI) and Statistical Approach. Proceedings of the Digital Technologies and Applications: Proceedings of ICDTA’22, Fez, Morocco.10.1007/978-3-031-01942-5_4 ↗
66. Bajpai, A., Chaubey, S., Patro, B., and Verma, A. (2022, January 13–15). A Real-Time Approach to Classify the Water Quality of the River Ganga at Mehandi Ghat, Kannuaj. Proceedings of the 2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET), Kota Kinabalu, Malaysia.10.1109/IICAIET55139.2022.9936820 ↗
67. Chafloque, R., Rodriguez, C., Pomachagua, Y., and Hilario, M. (2021, January 22–23). Predictive Neural Networks Model for Detection of Water Quality for Human Consumption. Proceedings of the 2021 13th International Conference on Computational Intelligence and Communication Networks (CICN), Lima, Peru.10.1109/CICN51697.2021.9574673 ↗
68. El-Attar, N.E., Lotfy, H.R., and Awad, W.A. (2022, January 26–28). Performance of Artificial Intelligence Models in Analysis and Prediction of Water Potability. Proceedings of the 2022 International Telecommunications Conference (ITC-Egypt), Alexandria, Egypt.10.1109/ITC-Egypt55520.2022.9855743 ↗
69. Spatial prediction of groundwater potential mapping based on convolutional neural network (CNN) and support vector regression (SVR)10.1016/j.jhydrol.2020.125033 ↗
70. Lake water-level fluctuations forecasting using minimax probability machine regression, relevance vector machine, Gaussian process regression, and extreme learning machine10.1007/s11269-019-02346-0 ↗
71. Páliz Larrea, P., Zapata-Ríos, X., and Campozano Parra, L. (2021). Application of neural network models and ANFIS for water level forecasting of the Salve Faccha Dam in the Andean Zone in Northern Ecuador. Water, 13.10.3390/w13152011 ↗
72. Machine learning-based method for forecasting water levels in irrigation and drainage systems10.1016/j.eti.2021.101762 ↗
73. Using machine learning algorithms to predict groundwater levels in Indonesian tropical peatlands10.1016/j.scitotenv.2022.159701 ↗
74. Emami, M., Ahmadi, A., Daccache, A., Nazif, S., Mousavi, S.F., and Karami, H. (2022). County-level irrigation water demand estimation using machine learning: Case study of California. Water, 14.10.3390/w14121937 ↗
75. Predicting Groundwater Levels in Ogallala Aquifer Wells Using Hierarchical Cluster Analysis and artificial neural networks10.1061/JHYEFF.HEENG-5840 ↗
76. Remote sensing of fluorescent humification levels and its potential environmental linkages in lakes across China10.1016/j.watres.2022.119540 ↗
77. Neurocomputing intelligence models for lakes water level forecasting: A comprehensive review10.1007/s00521-022-07699-z ↗
78. Novel leakage detection and water loss management of urban water supply network using multiscale neural networks10.1016/j.jclepro.2020.123611 ↗
79. Leak detection and topology identification in pipelines using fluid transients and artificial neural networks10.1061/(ASCE)WR.1943-5452.0001187 ↗
80. Liu, Y., Ma, X., Li, Y., Tie, Y., Zhang, Y., and Gao, J. (2019). Water pipeline leakage detection based on machine learning and wireless sensor networks. Sensors, 19.10.3390/s19235086 ↗
81. Sun, C., Parellada, B., Puig, V., and Cembrano, G. (2019). Leak localization in water distribution networks using pressure and data-driven classifier approach. Water, 12.10.3390/w12010054 ↗
82. Leakage detection in water distribution systems based on time–frequency convolutional neural network10.1061/(ASCE)WR.1943-5452.0001317 ↗
83. Ensemble-based machine learning approach for improved leak detection in water mains10.2166/hydro.2021.093 ↗
84. Experimental investigation into techniques to predict leak shapes in water distribution systems using vibration measurements10.2166/hydro.2018.117 ↗
85. A hybrid model-based method for leak detection in large scale water distribution networks10.1007/s12652-020-02233-2 ↗
86. An iterative method for leakage zone identification in water distribution networks based on machine learning10.1177/1475921720950470 ↗
87. Levinas, D., Perelman, G., and Ostfeld, A. (2021). Water leak localization using high-resolution pressure sensors. Water, 13.10.3390/w13050591 ↗
88. Precise water leak detection using machine learning and real-time sensor data10.3390/iot1020026 ↗
89. Data-driven application of MEMS-based accelerometers for leak detection in water distribution networks10.1016/j.scitotenv.2021.151110 ↗
90. Machine-learning–based risk assessment method for leak detection and geolocation in a water distribution system10.1061/(ASCE)IS.1943-555X.0000517 ↗
91. Leak detection using flow-induced vibrations in pressurized wall-mounted water pipelines10.1109/ACCESS.2020.3032319 ↗
92. Use of machine learning for leak detection and localization in water distribution systems10.3390/smartcities4040069 ↗
93. Improving the leak detection efficiency in water distribution networks using noise loggers10.1016/j.scitotenv.2022.153530 ↗
94. Augmenting a deep-learning algorithm with canal inspection knowledge for reliable water leak detection from multispectral satellite images10.1016/j.aei.2020.101161 ↗
95. Leak detection in water distribution systems by classifying vibration signals10.1016/j.ymssp.2022.109810 ↗
96. AI-based acoustic leak detection in water distribution systems10.1016/j.rineng.2022.100557 ↗
97. Detection of Water Leaks in Suburban Distribution Mains with Lift and Shift Vibro-Acoustic Sensors10.3390/vibration5020021 ↗
98. A selective literature review on leak management techniques for water distribution system10.1007/s11269-018-1985-6 ↗
99. LSTM-AE-WLDL: Unsupervised LSTM Auto-Encoders for Leak Detection and Location in Water Distribution Networks10.1007/s11269-022-03397-6 ↗