journal article·2020-04-03Open access

Soft Computing Ensemble Models Based on Logistic Regression for Groundwater Potential Mapping

Phong Tung Nguyen, Duong Hai Ha, Mohammadtaghi Avand, Abolfazl Jaafari, Huu Duy Nguyen, Nadhir Al-Ansari, Tran Van Phong, Rohit Sharma, Raghvendra Kumar, Hiep Van Le, Lanh Si Ho, Indra Prakash, Binh Thai Pham

Applied Sciences· Volume 10· Issue 7

Abstract

Groundwater potential maps are one of the most important tools for the management of groundwater storage resources. In this study, we proposed four ensemble soft computing models based on logistic regression (LR) combined with the dagging (DLR), bagging (BLR), random subspace (RSSLR), and cascade generalization (CGLR) ensemble techniques for groundwater potential mapping in Dak Lak Province, Vietnam. A suite of well yield data and twelve geo-environmental factors (aspect, elevation, slope, curvature, Sediment Transport Index, Topographic Wetness Index, flow direction, rainfall, river density, soil, land use, and geology) were used for generating the training and validation datasets required for the building and validation of the models. Based on the area under the receiver operating characteristic curve (AUC) and several other validation methods (negative predictive value, positive predictive value, root mean square error, accuracy, sensitivity, specificity, and Kappa), it was revealed that all four ensemble learning techniques were successful in enhancing the validation performance of the base LR model. The ensemble DLR model (AUC = 0.77) was the most successful model in identifying the groundwater potential zones in the study area, followed by the RSSLR (AUC = 0.744), BLR (AUC = 0.735), CGLR (AUC = 0.715), and single LR model (AUC = 0.71), respectively. The models developed in this study and the resulting potential maps can assist decision-makers in the development of effective adaptive groundwater management plans.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Groundwater and Watershed Analysis · Hydrology and Watershed Management Studies · Hydrological Forecasting Using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Vietnam Academy for Water Resources, Hanoi 100000, Vietnam

Institute for Water and Environment, Hanoi 100000, Vietnam

Department of Watershed Management Engineering, College of Natural Resources, TarbiatModares University, Tehran, P.O. Box 14115-111, Iran

Research Institute of Forests and Rangelands, Agricultural Research, Education, and Extension Organization (AREEO), P.O. Box 64414-356, Tehran, Iran

Faculty of Geography, VNU University of Science, Vietnam National University, 334 Nguyen Trai, Hanoi 100000, Vietnam

Department of Civil, Environmental and Natural Resources Engineering, Lulea University of Technology, 971 87 Lulea, Sweden

Institute of Geological Sciences, Vietnam Academy of Sciences and Technology, 84 Chua Lang Street, Dong da, Hanoi 100000, Vietnam

Department of Electronics & Communication Engineering, SRM Institute of Science and Technology, Ghaziabad 201204, India

Department of Computer Science and Engineering, GIET University, Gunupur 765022, India

University of Transport Technology, Hanoi 100000, Vietnam

Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam

Department of Science & Technology, Bhaskarcharya Institute for Space Applications and Geo-Informatics (BISAG), Government of Gujarat, Gandhinagar 382002, India

References (95)

Show source-provided references
1. A comparison study of DRASTIC methods with various objective methods for groundwater vulnerability assessment10.1016/j.scitotenv.2018.06.130 ↗
2. Groundwater vulnerability and risk mapping using GIS, modeling and a fuzzy logic tool10.1016/j.jconhyd.2007.07.008 ↗
3. Mangrove regional feedback to sea level rise and drought intensity at the end of the 21st century10.1016/j.ecolind.2019.105972 ↗
4. Modeling multi-decadal mangrove leaf area index in response to drought along the semi-arid southern coasts of Iran10.1016/j.scitotenv.2018.11.462 ↗
5. Multi-hazards vulnerability assessment of southern coasts of Iran10.1016/j.jenvman.2019.109628 ↗
6. Spatially explicit predictions of changes in the extent of mangroves of Iran at the end of the 21st century10.1016/j.ecss.2020.106644 ↗
7. Choubin, B., Rahmati, O., Soleimani, F., Alilou, H., Moradi, E., and Alamdari, N. (2019). Regional groundwater potential analysis using classification and regression trees. Spatial Modeling in GIS and R for Earth and Environmental Sciences, Elsevier.10.1016/B978-0-12-815226-3.00022-3 ↗
8. Application of Dempster–Shafer theory, spatial analysis and remote sensing for groundwater potentiality and nitrate pollution analysis in the semi-arid region of Khuzestan, Iran10.1016/j.scitotenv.2016.06.176 ↗
9. Rahmati, O., Moghaddam, D.D., Moosavi, V., Kalantari, Z., Samadi, M., Lee, S., and Bui, D.T. (2019). An automated Python language-based tool for creating absence samples in groundwater potential mapping. Remote Sens., 11.10.3390/rs11111375 ↗
10. The effect of sample size on different machine learning models for groundwater potential mapping in mountain bedrock aquifers10.1016/j.catena.2019.104421 ↗
11. Groundwater spring potential modelling: Comprising the capability and robustness of three different modeling approaches10.1016/j.jhydrol.2018.08.027 ↗
12. Predicting uncertainty of machine learning models for modelling nitrate pollution of groundwater using quantile regression and UNEEC methods10.1016/j.scitotenv.2019.06.320 ↗
13. Identification of Groundwater Potential Zones Using Proxy Data: Case study of Megech Watershed, Ethiopia10.1016/j.ejrh.2020.100676 ↗
14. Naghibi, S.A., Dolatkordestani, M., Rezaei, A., Amouzegari, P., Heravi, M.T., Kalantar, B., and Pradhan, B. (2019). Application of rotation forest with decision trees as base classifier and a novel ensemble model in spatial modeling of groundwater potential. Environ. Monit. Assess., 191.10.1007/s10661-019-7362-y ↗
15. Golkarian, A., Naghibi, S.A., Kalantar, B., and Pradhan, B. (2018). Groundwater potential mapping using C5.0, random forest, and multivariate adaptive regression spline models in GIS. Environ. Monit. Assess., 190.10.1007/s10661-018-6507-8 ↗
16. GIS-based groundwater potential mapping using boosted regression tree, classification and regression tree, and random forest machine learning models in Iran10.1007/s10661-015-5049-6 ↗
17. GIS-based groundwater spring potential mapping using data mining boosted regression tree and probabilistic frequency ratio models in Iran10.3934/geosci.2017.1.91 ↗
18. Application of GIS-based data driven random forest and maximum entropy models for groundwater potential mapping: A case study at Mehran Region, Iran10.1016/j.catena.2015.10.010 ↗
19. Application of Support Vector Machine, Random Forest, and Genetic Algorithm Optimized Random Forest Models in Groundwater Potential Mapping10.1007/s11269-017-1660-3 ↗
20. GIS-based groundwater potential mapping using artificial neural network and support vector machine models: The case of Boryeong city in Korea10.1080/10106049.2017.1303091 ↗
21. Park, S., Hamm, S.-Y., Jeon, H.-T., and Kim, J. (2017). Evaluation of logistic regression and multivariate adaptive regression spline models for groundwater potential mapping using R and GIS. Sustainability, 9.10.3390/su9071157 ↗
22. Golkarian, A., and Rahmati, O. (2018). Use of a maximum entropy model to identify the key factors that influence groundwater availability on the Gonabad Plain, Iran. Environ. Earth Sci., 77.10.1007/s12665-018-7551-y ↗
23. Evaluating the usage of tree-based ensemble methods in groundwater spring potential mapping10.1016/j.jhydrol.2020.124602 ↗
24. Mapping groundwater potential using a novel hybrid intelligence approach10.1007/s11269-018-2102-6 ↗
25. Avand, M., Janizadeh, S., Tien Bui, D., Pham, V.H., Ngo, P.T.T., and Nhu, V.-H. (2020). A tree-based intelligence ensemble approach for spatial prediction of potential groundwater. Int. J. Digit. Earth, 1–22.10.1080/17538947.2020.1718785 ↗
26. Al-Fugara, A.K., Ahmadlou, M., Al-Shabeeb, A.R., AlAyyash, S., Al-Amoush, H., and Al-Adamat, R. (2020). Spatial mapping of groundwater springs potentiality using grid search-based and genetic algorithm-based support vector regression. Geocarto Int., 1–20.10.1080/10106049.2020.1716396 ↗
27. Spatial prediction of groundwater spring potential mapping based on an adaptive neuro-fuzzy inference system and metaheuristic optimization10.5194/hess-22-4771-2018 ↗
28. Banadkooki, F.B., Ehteram, M., Ahmed, A.N., Teo, F.Y., Fai, C.M., Afan, H.A., Sapitang, M., and El-Shafie, A. (2020). Enhancement of Groundwater-Level Prediction Using an Integrated Machine Learning Model Optimized by Whale Algorithm. Nat. Resour. Res., 1–20.10.1007/s11053-020-09634-2 ↗
29. Arabameri, A., Lee, S., Tiefenbacher, J.P., and Ngo, P.T.T. (2020). Novel Ensemble of MCDM-Artificial Intelligence Techniques for Groundwater-Potential Mapping in Arid and Semi-Arid Regions (Iran). Remote Sens., 12.10.3390/rs12030490 ↗
30. Logistic regression applied to natural hazards: Rare event logistic regression with replications10.5194/nhess-12-1937-2012 ↗
31. Bayat, M., Ghorbanpour, M., Zare, R., Jaafari, A., and Thai Pham, B. (2019). Application of artificial neural networks for predicting tree survival and mortality in the Hyrcanian forest of Iran. Comput. Electron. Agric., 164.10.1016/j.compag.2019.104929 ↗
32. Predicting spatial patterns of wildfire susceptibility in the Huichang County, China: An integrated model to analysis of landscape indicators10.1016/j.ecolind.2019.01.056 ↗
33. Jaafari, A., Mafi-Gholami, D., Pham, B.T., and Tien Bui, D. (2019). Wildfire probability mapping: Bivariate vs. multivariate statistics. Remote Sens., 11.10.3390/rs11060618 ↗
34. Bagging predictors10.1007/BF00058655 ↗
35. Quinlan, J.R. Bagging, Boosting, and C4.5. Available online: http://www.cs.ecu.edu/~dingq/CSCI6905/readings/BaggingBoosting.pdf.
36. Nhu, V.-H., Janizadeh, S., Avand, M., Chen, W., Farzin, M., Omidvar, E., Shirzadi, A., Shahabi, H., Clague, J.J., and Jaafari, A. (2020). GIS-Based Gully Erosion Susceptibility Mapping: A Comparison of Computational Ensemble Data Mining Models. Appl. Sci., 10.10.3390/app10062039 ↗
37. Pham, B.T., Jaafari, A., Prakash, I., Singh, S.K., Quoc, N.K., and Bui, D.T. (2019). Hybrid computational intelligence models for groundwater potential mapping. Catena, 182.10.1016/j.catena.2019.104101 ↗
38. Bühlmann, P. (2012). Bagging, boosting and ensemble methods. Handbook of Computational Statistics, Springer.10.1007/978-3-642-21551-3_33 ↗
39. Ting, K.M., and Witten, I.H. (1997). Stacking Bagged and Dagged Models, University of Waikato, Department of Computer Science.
40. Cascade generalization10.1023/A:1007652114878 ↗
41. The random subspace method for constructing decision forests10.1109/34.709601 ↗
42. Bagging, boosting and the random subspace method for linear classifiers10.1007/s100440200011 ↗
43. Random subspace ensembles for fMRI classification10.1109/TMI.2009.2037756 ↗
44. Study of corporate credit risk prediction based on integrating boosting and random subspace
45. Bio-molecular cancer prediction with random subspace ensembles of support vector machines10.1016/j.neucom.2004.07.007 ↗
46. Wildfire spatial pattern analysis in the Zagros Mountains, Iran: A comparative study of decision tree based classifiers10.1016/j.ecoinf.2017.12.006 ↗
47. Landslide susceptibility assessment at a part of Uttarakhand Himalaya, India using GIS–based statistical approach of frequency ratio method
48. Landslide hazard assessment using random subspace fuzzy rules based classifier ensemble and probability analysis of rainfall data: A case study at Mu Cang Chai District, Yen Bai Province (Viet Nam)10.1007/s12524-016-0620-3 ↗
49. Spatial prediction of rainfall-induced landslides using aggregating one-dependence estimators classifier10.1007/s12524-018-0791-1 ↗
50. Nguyen, P.T., Ha, D.H., Nguyen, H.D., Van Phong, T., Trinh, P.T., Al-Ansari, N., Le, H.V., Pham, B.T., Ho, L.S., and Prakash, I. (2020). Improvement of Credal Decision Trees Using Ensemble Frameworks for Groundwater Potential Modeling. Sustainability, 12.10.3390/su12072622 ↗
51. A comparison of Support Vector Machines and Bayesian algorithms for landslide susceptibility modelling10.1080/10106049.2018.1489422 ↗
52. Application and comparison of decision tree-based machine learning methods in landside susceptibility assessment at Pauri Garhwal Area, Uttarakhand, India10.1007/s40710-017-0248-5 ↗
53. Pham, B.T., Prakash, I., Dou, J., Singh, S.K., Trinh, P.T., Tran, H.T., Le, T.M., Van Phong, T., Khoi, D.K., and Shirzadi, A. (2019). A novel hybrid approach of landslide susceptibility modelling using rotation forest ensemble and different base classifiers. Geocarto Int., 1–25.10.1080/10106049.2018.1559885 ↗
54. Nguyen, V.V., Pham, B.T., Vu, B.T., Prakash, I., Jha, S., Shahabi, H., Shirzadi, A., Ba, D.N., Kumar, R., and Chatterjee, J.M. (2019). Hybrid machine learning approaches for landslide susceptibility modeling. Forests, 10.10.3390/f10020157 ↗
55. Flash flood susceptibility modeling using an optimized fuzzy rule based feature selection technique and tree based ensemble methods10.1016/j.scitotenv.2019.02.422 ↗
56. A novel classifier based on composite hyper-cubes on iterated random projections for assessment of landslide susceptibility10.1007/s12594-018-0862-5 ↗
57. Landslide susceptibility modelling using different advanced decision trees methods10.1080/10286608.2019.1568418 ↗
58. Machine learning methods of kernel logistic regression and classification and regression trees for landslide susceptibility assessment at part of Himalayan area, India10.17485/ijst/2018/v11i12/99745 ↗
59. Nguyen, P.T., Tuyen, T.T., Shirzadi, A., Pham, B.T., Shahabi, H., Omidvar, E., Amini, A., Entezami, H., Prakash, I., and Phong, T.V. (2019). Development of a novel hybrid intelligence approach for landslide spatial prediction. Appl. Sci., 9.10.3390/app9142824 ↗
60. Thai Pham, B., Shirzadi, A., Shahabi, H., Omidvar, E., Singh, S.K., Sahana, M., Talebpour Asl, D., Bin Ahmad, B., Kim Quoc, N., and Lee, S. (2019). Landslide susceptibility assessment by novel hybrid machine learning algorithms. Sustainability, 11.10.3390/su11164386 ↗
61. Evaluation and comparison of LogitBoost Ensemble, Fisher’s Linear Discriminant Analysis, logistic regression and support vector machines methods for landslide susceptibility mapping10.1080/10106049.2017.1404141 ↗
62. Dou, J., Yunus, A.P., Bui, D.T., Merghadi, A., Sahana, M., Zhu, Z., Chen, C.-W., Han, Z., and Pham, B.T. (2019). Improved landslide assessment using support vector machine with bagging, boosting, and stacking ensemble machine learning framework in a mountainous watershed, Japan. Landslides, 1–18.10.1007/s10346-019-01286-5 ↗
63. Pham, B.T., Bui, D.T., and Prakash, I. (2018). Application of classification and regression trees for spatial prediction of rainfall-induced shallow landslides in the Uttarakhand area (India) using GIS. Climate Change, Extreme Events and Disaster Risk Reduction, Springer.10.1007/978-3-319-56469-2_11 ↗
64. Nguyen, V.-T., Tran, T.H., Ha, N.A., Ngo, V.L., Nadhir, A.-A., Tran, V.P., Duy Nguyen, H., MA, M., Amini, A., and Prakash, I. (2019). GIS Based Novel Hybrid Computational Intelligence Models for Mapping Landslide Susceptibility: A Case Study at Da Lat City, Vietnam. Sustainability, 11.10.3390/su11247118 ↗
65. Pham, B.T., Prakash, I., Chen, W., Ly, H.-B., Ho, L.S., Omidvar, E., Tran, V.P., and Bui, D.T. (2019). A Novel Intelligence Approach of a Sequential Minimal Optimization-Based Support Vector Machine for Landslide Susceptibility Mapping. Sustainability, 11.10.3390/su11226323 ↗
66. A novel hybrid approach of bayesian logistic regression and its ensembles for landslide susceptibility assessment10.1080/10106049.2018.1499820 ↗
67. GIS based frequency ratio method for landslide susceptibility mapping at Da Lat City, Lam Dong province, Vietnam10.15625/0866-7187/42/1/14758 ↗
68. A spatially explicit deep learning neural network model for the prediction of landslide susceptibility10.1016/j.catena.2019.104451 ↗
69. Moayedi, H., Tien Bui, D., Gör, M., Pradhan, B., and Jaafari, A. (2019). The feasibility of three prediction techniques of the artificial neural network, adaptive neuro-fuzzy inference system, and hybrid particle swarm optimization for assessing the safety factor of cohesive slopes. ISPRS Int. J. Geo-Inf., 8.10.3390/ijgi8090391 ↗
70. Janizadeh, S., Avand, M., Jaafari, A., Phong, T.V., Bayat, M., Ahmadisharaf, E., Prakash, I., Pham, B.T., and Lee, S. (2019). Prediction Success of Machine Learning Methods for Flash Flood Susceptibility Mapping in the Tafresh Watershed, Iran. Sustainability, 11.10.3390/su11195426 ↗
71. Jaafari, A. (2018). LiDAR-supported prediction of slope failures using an integrated ensemble weights-of-evidence and analytical hierarchy process. Environ. Earth Sci., 77.10.1007/s12665-017-7207-3 ↗
72. Pham, B.T., Phong, T.V., Nguyen-Thoi, T., Parial, K.K., Singh, S., Ly, H.-B., Nguyen, K.T., Ho, L.S., Le, H.V., and Prakash, I. (2020). Ensemble modeling of landslide susceptibility using random subspace learner and different decision tree classifiers. Geocarto Int., 1–23.10.1080/10106049.2020.1737972 ↗
73. A novel hybrid intelligent model of support vector machines and the MultiBoost ensemble for landslide susceptibility modeling10.1007/s10064-018-1281-y ↗
74. Ly, H.-B., Le, L.M., Phi, L.V., Phan, V.-H., Tran, V.Q., Pham, B.T., Le, T.-T., and Derrible, S. (2019). Development of an AI model to measure traffic air pollution from multisensor and weather data. Sensors, 19.10.3390/s19224941 ↗
75. Phong, T.V., Phan, T.T., Prakash, I., Singh, S.K., Shirzadi, A., Chapi, K., Ly, H.-B., Ho, L.S., Quoc, N.K., and Pham, B.T. (2019). Landslide susceptibility modeling using different artificial intelligence methods: A case study at Muong Lay district, Vietnam. Geocarto Int., 1–24.10.1080/10106049.2019.1665715 ↗
76. Pham, B.T., Phong, T.V., Nguyen, H.D., Qi, C., Al-Ansari, N., Amini, A., Ho, L.S., Tuyen, T.T., Yen, H.P.H., and Ly, H.-B. (2020). A Comparative Study of Kernel Logistic Regression, Radial Basis Function Classifier, Multinomial Naïve Bayes, and Logistic Model Tree for Flash Flood Susceptibility Mapping. Water, 12.10.3390/w12010239 ↗
77. A comparative study of sequential minimal optimization-based support vector machines, vote feature intervals, and logistic regression in landslide susceptibility assessment using GIS10.1007/s12665-017-6689-3 ↗
78. A novel artificial intelligence approach based on Multi-layer Perceptron Neural Network and Biogeography-based Optimization for predicting coefficient of consolidation of soil10.1016/j.catena.2018.10.004 ↗
79. Development of artificial intelligence models for the prediction of Compression Coefficient of soil: An application of Monte Carlo sensitivity analysis10.1016/j.scitotenv.2019.05.061 ↗
80. Pham, B.T., Nguyen-Thoi, T., Ly, H.-B., Nguyen, M.D., Al-Ansari, N., Tran, V.-Q., and Le, T.-T. (2020). Extreme Learning Machine Based Prediction of Soil Shear Strength: A Sensitivity Analysis Using Monte Carlo Simulations and Feature Backward Elimination. Sustainability, 12.10.3390/su12062339 ↗
81. Pham, B.T., Qi, C., Ho, L.S., Nguyen-Thoi, T., Al-Ansari, N., Nguyen, M.D., Nguyen, H.D., Ly, H.-B., Le, H.V., and Prakash, I. (2020). A Novel Hybrid Soft Computing Model Using Random Forest and Particle Swarm Optimization for Estimation of Undrained Shear Strength of Soil. Sustainability, 12.10.3390/su12062218 ↗
82. Flocculation-dewatering prediction of fine mineral tailings using a hybrid machine learning approach10.1016/j.chemosphere.2019.125450 ↗
83. A hybrid feature selection algorithm integrating an extreme learning machine for landslide susceptibility modeling of Mt. Woomyeon, South Korea10.1016/j.geomorph.2016.03.023 ↗
84. A comparative assessment of GIS-based data mining models and a novel ensemble model in groundwater well potential mapping10.1016/j.jhydrol.2017.03.020 ↗
85. Groundwater potential mapping using a novel data-mining ensemble model10.1007/s10040-018-1848-5 ↗
86. Kalantar, B., Al-Najjar, A.H.H., Pradhan, B., Saeidi, V., Halin, A.A., Ueda, N., and Naghibi, A.S. (2019). Optimized Conditioning Factors Using Machine Learning Techniques for Groundwater Potential Mapping. Water, 11.10.3390/w11091909 ↗
87. Genetic and firefly metaheuristic algorithms for an optimized neuro-fuzzy prediction modeling of wildfire probability10.1016/j.jenvman.2019.04.117 ↗
88. A novel hybrid approach based on a swarm intelligence optimized extreme learning machine for flash flood susceptibility mapping10.1016/j.catena.2019.04.009 ↗
89. Predicting slope stability failure through machine learning paradigms10.3390/ijgi8090395 ↗
90. Chen, W., Hong, H., Panahi, M., Shahabi, H., Wang, Y., Shirzadi, A., Pirasteh, S., Alesheikh, A.A., Khosravi, K., and Panahi, S. (2019). Spatial Prediction of Landslide Susceptibility Using GIS-Based Data Mining Techniques of ANFIS with Whale Optimization Algorithm (WOA) and Grey Wolf Optimizer (GWO). Appl. Sci., 9.10.3390/app9183755 ↗
91. Hybrid artificial intelligence models based on a neuro-fuzzy system and metaheuristic optimization algorithms for spatial prediction of wildfire probability10.1016/j.agrformet.2018.12.015 ↗
92. Landslide susceptibility modeling using Reduced Error Pruning Trees and different ensemble techniques: Hybrid machine learning approaches10.1016/j.catena.2018.12.018 ↗
93. Pham, B.T., Avand, M., Janizadeh, S., Phong, T.V., Al-Ansari, N., Ho, L.S., Das, S., Le, H.V., Amini, A., and Bozchaloei, S.K. (2020). GIS Based Hybrid Computational Approaches for Flash Flood Susceptibility Assessment. Water, 12.10.3390/w12030683 ↗
94. A novel hybrid artificial intelligence approach for flood susceptibility assessment10.1016/j.envsoft.2017.06.012 ↗
95. Land use change modeling through an integrated multi-layer perceptron neural network and Markov chain analysis (case study: Arasbaran region, Iran)10.1007/s11676-018-0659-9 ↗