journal article·2022-02-22Open access

A Comparative Assessment of Machine Learning Models for Landslide Susceptibility Mapping in the Rugged Terrain of Northern Pakistan

Naeem Shahzad, Xiaoli Ding, Sawaid Abbas

Applied Sciences· Volume 12· Issue 5

Abstract

This study investigated the performances of different techniques, including random forest (RF), support vector machine (SVM), maximum entropy (maxENT), gradient-boosting machine (GBM), and logistic regression (LR), for landslide susceptibility mapping (LSM) in the rugged terrain of northern Pakistan. Initially, a landslide inventory of 200 samples was produced along with an additional 200 samples indicating nonlandslide areas and divided into training (70%) and validation (30%) groups using a stratified loop-based random sampling approach. Then, a geospatial database of 12 possible landslide influencing factors (LIFs) was generated, including elevation, slope, aspect, topographic wetness index (TWI), topographic position index (TPI), distance to drainage, distance to fault, distance to road, normalized difference vegetation index (NDVI), rainfall, land cover/land use (LCLU), and a geological map of the study area. None of the LIFs were redundant for the modeling, as indicated by the multicollinearity test (tolerance > 0.1) and information gain ratio (IGR > 0). We extended the evaluation measures of each algorithm from area-under-the-curve (AUC) analysis to the calculation of performance overall (POA) with the help of precision, recall, F1 score, accuracy (ACC), and Matthew’s correlation coefficient (MCC). The results showed that the SVM was the most promising model (AUC = 0.969, POA = 2669) for the LSM, followed by RF (AUC = 0.967, POA = 2656), GBM (AUC = 0.967, POA = 2623), maxENT (AUC = 0.872, POA = 1761), and LR (AUC = 0.836, POA = 1299). It is important to note that the SVM, RF, and GBM were the top performers, with almost similar accuracy. Thus, each of these could be equally effective for LSM and can be used for risk reduction and mitigation measures in the rugged terrain of Pakistan and other regions with similar topography.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Landslides and related hazards · Fire effects on ecosystems · Tree Root and Stability Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong SAR, China

Research Institute for Land and Space, The Hong Kong Polytechnic University, Hong Kong SAR, China

Remote Sensing, GIS and Climatic Research Lab (RSGCRL), National Center of GIS and Space Applications, University of the Punjab, Lahore 54590, Pakistan

References (82)

Show source-provided references
1. Recommendations for the quantitative analysis of landslide risk
2. Landslide failures detection and mapping using Synthetic Aperture Radar: Past, present and future10.1016/j.earscirev.2021.103574 ↗
3. Combination of Rainfall Thresholds and Susceptibility Maps for Dynamic Landslide Hazard Assessment at Regional Scale10.3389/feart.2018.00085 ↗
4. Brabb, E.E. (September, January 28). Proposal for Worldwide Landslide Hazard Maps. Proceedings of the Seventh International Conference and Field Workshop on Landslides in Czech and Slovak Republics, Czech Republic and Slovakia.
5. Landslide inventory maps: New tools for an old problem10.1016/j.earscirev.2012.02.001 ↗
6. Machine learning for landslides prevention: A survey10.1007/s00521-020-05529-8 ↗
7. Support Vector Machines for Landslide Susceptibility Mapping: The Staffora River Basin Case Study, Italy10.1007/s11004-011-9379-9 ↗
8. Spatial prediction models for landslide hazards: Review, comparison and evaluation10.5194/nhess-5-853-2005 ↗
9. Application of an Incomplete Landslide Inventory and One Class Classifier to Earthquake-Induced Landslide Susceptibility Mapping10.1109/JSTARS.2020.2985088 ↗
10. Lee, S., Hong, S.-M., and Jung, H.-S. (2017). A Support Vector Machine for Landslide Susceptibility Mapping in Gangwon Province, Korea. Sustainability, 9.10.3390/su9010048 ↗
11. Using maximum entropy modeling for landslide susceptibility mapping with multiple geoenvironmental data sets10.1007/s12665-014-3442-z ↗
12. Guidelines for landslide susceptibility, hazard and risk zoning for land use planning10.1016/j.enggeo.2008.03.022 ↗
13. Factor analysis of earthquake-induced geological disasters of the M7. 0 Lushan earthquake in China10.3724/SP.J.1246.2013.02022 ↗
14. Samui, P., Sekhar, S., and Balas, V.E. (2017). Chapter 24-Applying Machine Learning Algorithms in Landslide Susceptibility Assessments. Handbook of Neural Computation, Academic Press.
15. Pradhan, S.P., Vishal, V., and Singh, T.N. (2019). Machine Learning Techniques in Landslide Susceptibility Mapping: A Survey and a Case Study. Landslides: Theory, Practice and Modelling, Springer International Publishing. Advances in Natural and Technological Hazards Research 50.
16. Advanced methods in landslide modelling10.1007/s11069-014-1320-3 ↗
17. Landslide disaster prevention and mitigation through works in Hong Kong10.1016/j.jrmge.2013.07.007 ↗
18. Analysis and evaluation of landslide susceptibility: A review on articles published during 2005–2016 (periods of 2005–2012 and 2013–2016)10.1007/s12517-018-3531-5 ↗
19. Landslide hazard evaluation: A review of current techniques and their application in a multi-scale study, Central Italy10.1016/S0169-555X(99)00078-1 ↗
20. Presenting logistic regression-based landslide susceptibility results10.1016/j.enggeo.2018.07.019 ↗
21. Spatial prediction models for shallow landslide hazards: A comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree10.1007/s10346-015-0557-6 ↗
22. A comparative study on the predictive ability of the decision tree, support vector machine and neuro-fuzzy models in landslide susceptibility mapping using GIS10.1016/j.cageo.2012.08.023 ↗
23. Assessment of advanced random forest and decision tree algorithms for modeling rainfall-induced landslide susceptibility in the Izu-Oshima Volcanic Island, Japan10.1016/j.scitotenv.2019.01.221 ↗
24. Assessing the predictive capability of ensemble tree methods for landslide susceptibility mapping using XGBoost, gradient boosting machine, and random forest10.1007/s42452-020-3060-1 ↗
25. Landslide susceptibility assessment in Lianhua County (China): A comparison between a random forest data mining technique and bivariate and multivariate statistical models10.1016/j.geomorph.2016.02.012 ↗
26. Should topographic metrics be considered when predicting species density of birds on a large geographical scale? A case of Random Forest approach10.1016/j.ecolmodel.2017.01.024 ↗
27. Generalised Additive Models and Random Forest Approach as effective methods for predictive species density and functional species richness10.1007/s10651-020-00445-5 ↗
28. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
29. Machine learning methods for landslide susceptibility studies: A comparative overview of algorithm performance10.1016/j.earscirev.2020.103225 ↗
30. Arabameri, A., Saha, S., Roy, J., Chen, W., Blaschke, T., and Bui, D.T. (2020). Landslide susceptibility evaluation and management using different machine learning methods in the Gallicash River Watershed, Iran. Remote Sens., 12.10.3390/rs12030475 ↗
31. Large-Scale Landslide Susceptibility Mapping Using an Integrated Machine Learning Model: A Case Study in the Lvliang Mountains of China10.3389/feart.2021.722491 ↗
32. Merghadi, A., Abderrahmane, B., and Tien Bui, D. (2018). Landslide susceptibility assessment at Mila basin (Algeria): A comparative assessment of prediction capability of advanced machine learning methods. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7070268 ↗
33. Wang, Z., Liu, Q., and Liu, Y. (2020). Mapping landslide susceptibility using machine learning algorithms and GIS: A case study in Shexian county, Anhui province, China. Symmetry, 12.10.3390/sym12121954 ↗
34. Qing, F., Zhao, Y., Meng, X., Su, X., Qi, T., and Yue, D. (2020). Application of machine learning to debris flow susceptibility mapping along the China-Pakistan Karakoram Highway. Remote Sens., 12.10.3390/rs12182933 ↗
35. GIS-based landslide susceptibility modeling: A comparison between fuzzy multi-criteria and machine learning algorithms10.1016/j.gsf.2020.09.004 ↗
36. The Lack of a Priori Distinctions between Learning Algorithms10.1162/neco.1996.8.7.1341 ↗
37. Lazzari, M. (2020). Remote Sensing Approaches and Related Techniques to Map and Study Landslides, IntechOpen. Chapter 2.
38. Landslide Environment in Pakistan after the Earthquake-2005: Information Revisited to Develop Safety Guidelines for Minimizing Future Impacts
39. Disaster risk and vulnerability in Pakistan at a district level10.1080/19475705.2011.626083 ↗
40. International Federation of Red Cross and Crescent Societies (2003). World Disasters Report, IFRC.
41. A regional level preliminary landslide susceptibility study of the upper Indus river basin10.5721/EuJRS20144721 ↗
42. Empirical assessment of rockfall and debris flow risk along the Karakoram Highway, Pakistan10.1007/s11069-021-04549-4 ↗
43. Rifting, subduction and collisional records from pluton petrogenesis and geochronology in the Hindu Kush, NW Pakistan10.1016/j.gr.2015.05.014 ↗
44. Pêcher, A., Seeber, L., Guillot, S., Jouanne, F., Kausar, A., Latif, M., Majid, A., Mahéo, G., Mugnier, J.L., and Rolland, Y. (2008). Stress field evolution in the northwest Himalayan syntaxis, northern Pakistan. Tectonics, 27.10.1029/2007TC002252 ↗
45. Global fatal landslide occurrence from 2004 to 201610.5194/nhess-18-2161-2018 ↗
46. Sassa, K., Canuti, P., and Yin, Y. (2014). Global Catalog of Rainfall-Triggered Landslides for Spatial and Temporal Hazard Characterization. Landslide Science for a Safer Geoenvironment, Springer International Publishing.10.1007/978-3-319-04996-0 ↗
47. Spatial and temporal analysis of a global landslide catalog10.1016/j.geomorph.2015.03.016 ↗
48. Evaluating digital terrain indices for soil wetness mapping-a Swedish case study10.5194/hess-18-3623-2014 ↗
49. Shekhar, S., Xiong, H., and Zhou, X. (2017). Encyclopedia of GIS, Springer International Publishing.10.1007/978-3-319-17885-1 ↗
50. Rouse, J.W., Haas, R.H., Schell, J.A., and Deeering, D. (1973, January 10–14). Monitoring vegetation systems in the Great Plains with ERTS (Earth Resources Technology Satellite). Proceedings of the Third Earth Resources Technology Satellite-1, Washington, DC, USA.
51. Object based image analysis for remote sensing10.1016/j.isprsjprs.2009.06.004 ↗
52. Induction of decision trees10.1007/BF00116251 ↗
53. Menard, S.W. (1995). Applied Logistic Regression Analysis, Sage Publications.
54. Multicollinearity10.1002/wics.84 ↗
55. Multicollinearity in Regression Analysis Comment10.2307/1926450 ↗
56. Random forests10.1023/A:1010933404324 ↗
57. James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning, Springer Texts, Springers.10.1007/978-1-4614-7138-7 ↗
58. A kernel functions analysis for support vector machines for land cover classification
59. GIS-based support vector machine modeling of earthquake-triggered landslide susceptibility in the Jianjiang River watershed, China10.1016/j.geomorph.2011.12.040 ↗
60. Maximum entropy modeling of species geographic distributions10.1016/j.ecolmodel.2005.03.026 ↗
61. A statistical explanation of MaxEnt for ecologists10.1111/j.1472-4642.2010.00725.x ↗
62. Machine Learning Feature Selection Methods for Landslide Susceptibility Mapping10.1007/s11004-013-9511-0 ↗
63. Predicting fish species richness in estuaries: Which modelling technique to use?10.1016/j.envsoft.2014.12.010 ↗
64. McCullagh, P., and Nelder, J.A. (1989). Generalized Linear Models (Monographs on Statistics and Applied Probability), Chapman and Hall/CRC. [2nd ed.].10.1007/978-1-4899-3242-6 ↗
65. Wang, H., Zhang, L., Yin, K., Luo, H., and Li, J. (2020). Landslide identification using machine learning. Geosci. Front.
66. Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.J. (1984). Classification and Regression Trees, Chapman and Hall/CRC.
67. The Data Model Concept in Statistical Mapping
68. Flach, P. (2011). ROC Analysis. Encyclopedia of Machine Learning, Springer.10.1007/978-0-387-30164-8_733 ↗
69. Measuring the accuracy of diagnostic systems10.1126/science.3287615 ↗
70. Statistical geocomputing combining R and SAGA: The example of landslide susceptibility analysis with generalized additive models
71. Jain, A.K., Duin, R.P.W., and Mao, J. (2000). Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intell.10.1109/34.824819 ↗
72. Koukis, G., Rozos, D., and Hadzinakos, I. (1997, January 23–27). Relationship between rainfall and landslides in the formations of Achaia County, Greece. Proceedings of the International Symposium on Engineering Geology and the Environment, Athens, Greece.
73. Landslide risk assessment and management: An overview10.1016/S0013-7952(01)00093-X ↗
74. Landslide susceptibility mapping based on Support Vector Machine: A case study on natural slopes of Hong Kong, China10.1016/j.geomorph.2008.02.011 ↗
75. Evaluating machine learning and statistical prediction techniques for landslide susceptibility modeling10.1016/j.cageo.2015.04.007 ↗
76. Comparison of landslide susceptibility mapping methodologies for Koyulhisar, Turkey: Conditional probability, logistic regression, artificial neural networks, and support vector machine10.1007/s12665-009-0394-9 ↗
77. Landslide susceptibility mapping using machine learning algorithms and comparison of their performance at Abha Basin, Asir Region, Saudi Arabia10.1016/j.gsf.2020.05.010 ↗
78. Kalantar, B., Ueda, N., Saeidi, V., Ahmadi, K., Halin, A.A., and Shabani, F. (2020). Landslide susceptibility mapping: Machine and ensemble learning based on remote sensing big data. Remote Sens., 12.10.3390/rs12111737 ↗
79. De Maio, M., and Tiwari, A.K. (2020). Evaluation of Prediction Capability of the MaxEnt and Frequency Ratio Methods for Landslide Susceptibility in the Vernazza Catchment (Cinque Terre, Italy). Applied Geology: Approaches to Future Resource Management, Springer International Publishing.
80. Landslide susceptibility mapping using maximum entropy and support vector machine models along the highway corridor, Garhwal Himalaya10.1080/10106049.2018.1510038 ↗
81. Mapping landslide susceptibility with logistic regression, multiple adaptive regression splines, classification and regression trees, and maximum entropy methods: A comparative study10.1007/s10346-012-0320-1 ↗
82. (2020, May 20). Dawn Six Killed as Heavy Rains Pound KP 2019. Available online: https://www.dawn.com/news/1496462.