journal article·2025-07-29Open access

Comparative Performance of Machine Learning Models for Landslide Susceptibility Assessment: Impact of Sampling Strategies in Highway Buffer Zone

Zhenyu Tang, Shumao Qiu, Haoying Xia, Daming Lin, Mingzhou Bai

Applied Sciences· Volume 15· Issue 15

Abstract

Landslide susceptibility assessment is critical for hazard mitigation and land-use planning. This study evaluates the impact of two different non-landslide sampling methods—random sampling and sampling constrained by the Global Landslide Hazard Map (GLHM)—on the performance of various machine learning and deep learning models, including Naïve Bayes (NB), Support Vector Machine (SVM), SVM-Random Forest hybrid (SVM-RF), and XGBoost. The study area is a 2 km buffer zone along the Duku Highway in Xinjiang, China, with 102 landslide and 102 non-landslide points extracted by aforementioned sampling methods. Models were tested using ROC curves and non-parametric significance tests based on 20 repetitions of 5-fold spatial cross-validation data. GLHM sampling consistently improved AUROC and accuracy across all models (e.g., AUROC gains: NB +8.44, SVM +7.11, SVM–RF +3.45, XGBoost +3.04; accuracy gains: NB +11.30%, SVM +8.33%, SVM–RF +7.40%, XGBoost +8.31%). XGBoost delivered the best performance under both sampling strategies, reaching 94.61% AUROC and 84.30% accuracy with GLHM sampling. SHAP analysis showed that GLHM sampling stabilized feature importance rankings, highlighting STI, TWI, and NDVI as the main controlling factors for landslides in the study area. These results highlight the importance of hazard-informed sampling to enhance landslide susceptibility modeling accuracy and interpretability.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Landslides and related hazards · Geotechnical Engineering and Analysis · Tree Root and Stability Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research Institute of Highway, Ministry of Transport, Beijing 100088, China

School of Civil Engineering, Beijing Jiaotong University, Beijing 100044, China

Funding

Natural Science Foundation of China Projects · Major Projects of Financial Science and Technology Plan of Xinjiang Production and Construction Corps

References (51)

Show source-provided references
1. Research in the field of natural hazards based on bibliometric analysis10.1061/NHREFO.NHENG-1739 ↗
2. Advances in the study of natural disasters induced by the 23.7 extreme rainfall event in North China10.1016/j.nhres.2025.01.003 ↗
3. (2025, March 14). Ministry of Natural Resources, P.R.C. China Natural Resources Statistics Bulletin 2024, Available online: https://gi.mnr.gov.cn/202503/t20250314_2881937.html.
4. Landslide hazard assessment: Summary review and new perspectives10.1007/s100640050066 ↗
5. Carrara, A., Guzzetti, F., Cardinali, M., and Reichenbach, P. (1998). Current limitations in modeling landslide hazard. Proceedings of IAMG, De Frede Editori.
6. Gaidzik, K., and Ramírez-Herrera, M.T. (2021). The importance of input data on landslide susceptibility mapping. Sci. Rep., 11.10.1038/s41598-021-98830-y ↗
7. A review on landslide susceptibility mapping research in Bangladesh10.1016/j.heliyon.2023.e17972 ↗
8. Machine learning and deep learning-based landslide susceptibility mapping using geospatial techniques in Wayanad, Kerala state, India10.1016/j.hydres.2024.10.001 ↗
9. Uncertainties of landslide susceptibility prediction: Influences of different spatial resolutions, machine learning models and proportions of training and testing dataset10.1016/j.rockmb.2023.100028 ↗
10. Feature adaptation for landslide susceptibility assessment in “no sample” areas10.1016/j.gr.2024.03.002 ↗
11. How do the landslide and non-landslide sampling strategies impact landslide susceptibility assessment?—A catchment-scale case study from China10.1016/j.jrmge.2023.07.026 ↗
12. Ensemble learning landslide susceptibility assessment with optimized non-landslide samples selection10.1080/19475705.2024.2378176 ↗
13. A novel deep learning framework for landslide susceptibility assessment using improved deep belief networks with the intelligent optimization algorithm10.1016/j.compgeo.2024.106106 ↗
14. Evaluating machine learning and statistical prediction techniques for landslide susceptibility modeling10.1016/j.cageo.2015.04.007 ↗
15. Nurwatik, N., Ummah, M.H., Cahyono, A.B., Darminto, M.R., and Hong, J.-H. (2022). A Comparison Study of Landslide Susceptibility Spatial Modeling Using Machine Learning. ISPRS Int. J. Geo-Inf., 11.10.3390/ijgi11120602 ↗
16. Landslide susceptibility mapping based on the reliability of landslide and non-landslide sample10.1016/j.eswa.2023.122933 ↗
17. The Alasu rock avalanche in the Tianshan Mountains, China: Fragmentation, landforms, and kinematics10.1007/s10346-023-02167-8 ↗
18. Terminal suturing between the Tarim Craton and the Yili-Central Tianshan arc: Insights from mélange-ocean plate stratigraphy, detrital zircon ages, and provenance of the South Tianshan accretionary complex10.1029/2021TC006705 ↗
19. Formation of HP–LT rocks and their tectonic implications in the western Tianshan Orogen, NW China: Geochemical and age constraints10.1016/S0024-4937(02)00153-6 ↗
20. Landslide susceptibility assessment along the Red Sea Coast in Egypt, based on multi-criteria spatial analysis and GIS techniques
21. Landslide susceptibility modelling using GIS-based machine learning techniques for Chongren County, Jiangxi Province, China10.1016/j.scitotenv.2018.01.124 ↗
22. An approach to reduce mapping errors in the production of landslide inventory maps10.5194/nhess-15-2111-2015 ↗
23. Landslide susceptibility index based on the integration of logistic regression and weights of evidence: A case study in Popayan, Colombia10.1016/j.enggeo.2020.105958 ↗
24. GIS-based geo-environmental evaluation for urban land-use planning: A case study10.1016/S0013-7952(01)00028-X ↗
25. Landslide risk analysis between Giri and Tons Rivers in Himachal Himalaya (India)
26. A comparative study of least square support vector machines and multiclass alternating decision trees for spatial prediction of rainfall-induced landslides in a tropical cyclones area10.1007/s10706-016-9990-0 ↗
27. Lineaments of the Atlantic border region10.1130/GSAB-15-483 ↗
28. Landslide susceptibility assessment using SVM machine learning algorithm10.1016/j.enggeo.2011.09.006 ↗
29. Using maximum entropy modeling for landslide susceptibility mapping with multiple geoenvironmental data sets10.1007/s12665-014-3442-z ↗
30. Hybrid integration of Multilayer Perceptron Neural Networks and machine learning ensembles for landslide susceptibility assessment at Himalayan area (India) using GIS10.1016/j.catena.2016.09.007 ↗
31. Risk analysis of road networks under the influence of landslides by considering landslide susceptibility and road vulnerability: A case study
32. Snowmelt-triggered reactivation of a loess landslide in Yili, Xinjiang, China: Mode and mechanism10.1007/s10346-022-01879-7 ↗
33. Zhuang, M., Gao, W., Zhao, T., Hu, R., Wei, Y., Shao, H., and Zhu, S. (2021). Mechanistic Investigation of Typical Loess Landslide Disasters in Ili Basin, Xinjiang, China. Sustainability, 13.10.3390/su13020635 ↗
34. The China Active Faults Database (CAFD) and its web system10.5194/essd-16-3391-2024 ↗
35. Trends and variability in snowmelt in China under climate change10.5194/hess-26-305-2022 ↗
36. The origins of kriging10.1007/BF00889887 ↗
37. Sample size matters: Investigating the effect of sample size on a logistic regression susceptibility model for debris flows10.5194/nhess-14-259-2014 ↗
38. Sammut, C., and Webb, G.I. (2010). Naïve Bayes. Encyclopedia of Machine Learning, Springer US.10.1007/978-0-387-30164-8 ↗
39. Support-vector networks10.1023/A:1022627411411 ↗
40. Random forests10.1023/A:1010933404324 ↗
41. Chen, T., and Guestrin, C. (2016). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/2939672.2939785 ↗
42. Detecting rock glacier flow structures using Gabor filters and IKONOS imagery10.1016/j.rse.2012.07.005 ↗
43. Ruß, G., and Brenning, A. (July, January 28). Data mining in precision agriculture: Management of spatial information. Proceedings of the Computational Intelligence for Knowledge-Based Systems Design: 13th International Conference on Information Processing and Management of Uncertainty, IPMU 2010, Dortmund, Germany. Proceedings 13.
44. MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Statistics, 1967, University of California Press.
45. Lundberg, S.M., and Lee, S.-I. (2017). A unified approach to interpreting model predictions. Adv. Neural Inf. Process. Syst., 30.
46. Rao, A.R., Wang, H., and Gupta, C. (2025). Predictive Analysis for Optimizing Port Operations. Appl. Sci., 15.10.3390/app15062877 ↗
47. Statistical relationships between topography and precipitation patterns10.1175/1520-0442(1994)007<1305:SRBTAP>2.0.CO;2 ↗
48. Climatic and geological factors contributing to the natural water chemistry in an arid environment from watersheds in northern Xinjiang, China
49. Zheng, B., Chen, K., Li, B., Li, Y., Shi, L., and Fan, H. (2024). Climate change impacts on precipitation and water resources in Northwestern China. Front. Environ. Sci., 12.10.3389/fenvs.2024.1377286 ↗
50. Relationship between continuous or discontinuous of controlling factors and landslide susceptibility in the high-cold mountainous areas, China10.1016/j.ecolind.2025.113313 ↗
51. The data model concept in statistical mapping