journal article·2025-12-29Open access

Frequency Ratio–Guided Optimization of Negative Sample Selection and Sample Ratio for Landslide Susceptibility Assessment: A Case Study of the Heishui River Basin, China

Zhen Yang, Miao Shi, Hongbo Mei, Meinan Zheng, Jiajia Yuan, Lei Wang

Applied Sciences· Volume 16· Issue 1

Abstract

In response to the shortage of theoretical support for negative sample selection and the imbalance between positive and negative samples in landslide susceptibility assessment (LSA), this study presents a dual optimization framework of sampling strategy and sample ratio based on the frequency ratio (FR) model and evaluates its performance in the Heishui River Basin using the random forest (RF) model. At the level of negative sample optimization, FR is used to quantify the spatial associations between landslides and environmental factors, delineate non-landslide zones as the source region for negative samples, and systematically compare the performance of five sampling strategies—random, buffer-zone, low-slope, low-density, and FR-optimized sampling. At the level of ratio adjustment, an innovative positive–negative sample ratio model based on the area ratio between susceptible and non-susceptible zones (1:1.3) is proposed, and four additional schemes (1:1, 1:2, 1:2.5, and 1:3) are designed for comparison. The results show that the FR-optimized sampling strategy provides the best discriminative performance, with AUC (area under the curve) = 0.992, Kappa = 0.964, accuracy = 0.982, and F1 score = 0.982, and achieves the highest mean metric value (0.980) and the lowest standard deviation (0.008). The 1:1.3 ratio scheme maintains the highest mean performance (0.982) and the lowest standard deviation (0.007), while yielding the optimal Kappa (0.968) and F1 score (0.982), confirming its advantages in classification balance and model stability. Spatial prediction results indicate that very high and high susceptibility zones are concentrated along both sides of the middle and lower reaches of the Heishui River Basin, occupying only 18.52% of the total area but containing 98.38% of the mapped landslide points, which strongly supports the reliability of the proposed model in identifying landslide risk hotspots. The proposed dual optimization framework not only enhances the robustness of susceptibility mapping but can also be directly applied to risk screening for territorial spatial planning and engineering development in the Heishui River Basin.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Landslides and related hazards · Flood Risk Assessment and Management · Synthetic Aperture Radar (SAR) Applications and Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Geomatics, Anhui University of Science and Technology, Huainan 232001, China

Coal Industry Engineering Research Center of Mining Area Environmental and Disaster Cooperative Monitoring, Anhui University of Science and Technology, Huainan 232001, China

Key Laboratory of Aviation-Aerospace-Ground Cooperative Monitoring and Early Warning of Coal Mining-Induced Disasters of Anhui Higher Education Institutes, Anhui University of Science and Technology, Huainan 232001, China

School of Earth Resources, China University of Geosciences, Wuhan 430074, China

Digital Geology Center, Geological Bureau of Xinjiang Uygur Autonomous Region, Urumqi 830000, China

Funding

Natural Science Research Project of Anhui Educational Committee

References (74)

Show source-provided references
1. A Review of Statistically-Based Landslide Susceptibility Models10.1016/j.earscirev.2018.03.001 ↗
2. Remondo, J., Sánchez-Díaz, M., and Cuesta-Albertos, J.A. (2025). An increasing trend of landslides as a consequence of the global change. Earth Syst. Environ., 1–14.10.1007/s41748-025-00685-0 ↗
3. Global projections of future landslide susceptibility under climate change10.1016/j.gsf.2025.102074 ↗
4. Climate change has increased rainfall-induced landslide damages in central China10.1016/j.ijdrr.2025.105320 ↗
5. Post-earthquake spatiotemporal evolution characteristics of typical landslide sources in the Jiuzhaigou meizoseismal area10.1007/s10064-024-03724-8 ↗
6. Human activities are intensifying the spatial variation of landslides in the Yellow River Basin10.1016/j.scib.2024.07.007 ↗
7. From Hazard Mapping to Risk Governance: 20-Year Trajectory of Land Use/Cover Change Impacts on Landslide Susceptibility via Multi-Modal Scientometrics10.1057/s41599-025-05831-7 ↗
8. Interactions between deforestation, landscape rejuvenation, and shallow landslides in the North Tanganyika–Kivu rift region, Africa10.5194/esurf-9-445-2021 ↗
9. How climate change and unplanned urban sprawl bring more landslides10.1038/d41586-022-02141-9 ↗
10. Important considerations in machine learning-based landslide susceptibility assessment under future climate conditions10.1007/s11440-024-02363-3 ↗
11. Landslide susceptibility assessment using lightweight dense residual network with emphasis on deep spatial features10.1038/s41598-025-97074-4 ↗
12. Kudaibergenov, M., Nurakynov, S., Iskakov, B., Iskaliyeva, G., Maksum, Y., Orynbassarova, E., Akhmetov, B., and Sydyk, N. (2025). Application of artificial intelligence in landslide susceptibility assessment: Review of recent progress. Remote Sens., 17.10.3390/rs17010034 ↗
13. Gao, X., Wang, B., Dai, W., and Liu, Y. (2025). A landslide susceptibility assessment method using SBAS-InSAR to optimize Bayesian network. Front. Environ. Sci., 13.10.3389/fenvs.2025.1522949 ↗
14. Merghadi, A., Abderrahmane, B., and Tien Bui, D. (2018). Landslide susceptibility assessment at Mila Basin (Algeria): A comparative assessment of prediction capability of advanced machine learning methods. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7070268 ↗
15. Nhu, V.-H., Mohammadi, A., Shahabi, H., Bin Ahmad, B., Al-Ansari, N., Shirzadi, A., Clague, J.J., Jaafari, A., Chen, W., and Nguyen, H. (2020). Landslide susceptibility mapping using machine learning algorithms and remote sensing data in a tropical environment. Int. J. Environ. Res. Public Health, 17.10.3390/ijerph17144933 ↗
16. Ado, M., Amitab, K., Maji, A.K., Jasińska, E., Gono, R., Leonowicz, Z., and Jasiński, M. (2022). Landslide susceptibility mapping using machine learning: A literature survey. Remote Sens., 14.10.3390/rs14133029 ↗
17. Evaluation of landslide susceptibility in the northern section of the Xiaojiang fault zone based on factor optimization10.1007/s10346-024-02448-w ↗
18. Application of information gain in the selection of factors for regional slope stability evaluation10.1007/s10064-022-02970-y ↗
19. Landslide Susceptibility Mapping Using Information Value and Logistic Regression Models in Goncha Siso Eneses Area, Northwestern Ethiopia10.1007/s42452-020-2563-0 ↗
20. A Python system for regional landslide susceptibility assessment by integrating machine learning models and its application10.1016/j.heliyon.2023.e21542 ↗
21. Landslide susceptibility assessment using frequency ratio model in Bogor, West Java, Indonesia10.1186/s40562-019-0140-4 ↗
22. Submarine landslide susceptibility assessment integrating frequency ratio with supervised machine learning approach10.1016/j.apor.2024.104237 ↗
23. Kumar, A., Kanga, S., Choudhury, U., Singh, S.K., Rana, R.S., Meraj, G., and Kumar, P. (2025). Landslide susceptibility mapping using statistical information value model: A case study of part of Chamoli District, Uttarakhand India. Risk Anal.10.1111/risa.70141 ↗
24. Cao, X., Wu, B., Shang, Y., Wang, W., Xu, T., Li, Q., and Meng, H. (2024). Evaluation of landslide susceptibility in Tekes County, Yili Prefecture based on the information quantity method. Appl. Sci., 14.10.3390/app14146053 ↗
25. Spatial distribution law of landslides and landslide susceptibility assessment in the eastern Himalayan syntaxis region10.1144/qjegh2023-144 ↗
26. Machine learning methods for landslide mapping studies: A comparative study of SVM and RF algorithms in the Oued Aoulai watershed (Morocco)10.1515/geo-2022-0740 ↗
27. Landslide susceptibility prediction by gray wolf optimized support vector machine model under different factor states10.1117/1.JRS.17.044510 ↗
28. Landslide hazard assessment of an urban agglomeration in central Guizhou Province based on an information value method and SVM, bagging, DNN algorithm10.1038/s41598-025-86258-7 ↗
29. Nanehkaran, Y.A., Chen, B., Cemiloglu, A., Chen, J., Anwar, S., Azarafza, M., and Derakhshani, R. (2023). Riverside landslide susceptibility overview: Leveraging artificial neural networks and machine learning in accordance with the United Nations (UN) sustainable development goals. Water, 15.10.3390/w15152707 ↗
30. Liu, H., Ding, Q., Yang, X., Liu, Q., Deng, M., and Gui, R. (2024). A knowledge-guided approach for landslide susceptibility mapping using convolutional neural network and graph contrastive learning. Sustainability, 16.10.3390/su16114547 ↗
31. Amato, G., Fiorucci, M., Martino, S., Lombardo, L., and Palombi, L. (EarthArXiv, 2021). Earthquake-triggered landslide susceptibility in Italy by means of artificial neural network, EarthArXiv, preprint.10.31223/X59W39 ↗
32. Landslide susceptibility modeling by interpretable neural network10.1038/s43247-023-00806-5 ↗
33. Enhancing landslide susceptibility predictions with XGBoost and SHAP: A data-driven explainable AI method10.1080/10106049.2025.2514725 ↗
34. Rondinone, M., Dal Sasso, S.F., Aung, H.H., Contillo, L., Dimola, G., Schiattarella, M., Fiorentino, M., and Telesca, V. (2025). Assessing flood and landslide susceptibility using XGBoost: Case study of the Basento River in southern Italy. Appl. Sci., 15.10.3390/app15105290 ↗
35. Assessment of advanced random forest and decision tree algorithms for modeling rainfall-induced landslide susceptibility in the Izu-Oshima volcanic island, Japan10.1016/j.scitotenv.2019.01.221 ↗
36. Improving landslide susceptibility mapping in semi-arid regions using machine learning and geospatial techniques
37. Landslide susceptibility mapping using random forest and extreme gradient boosting: A case study of Fengjie County, Chongqing, China10.1002/gj.4683 ↗
38. Wu, X., Song, Y., Chen, W., Kang, G., Qu, R., Wang, Z., Wang, J., Lv, P., and Chen, H. (2023). Analysis of geological hazard susceptibility of landslides in Muli County based on random forest algorithm. Sustainability, 15.10.3390/su15054328 ↗
39. The importance of input data on landslide susceptibility mapping10.1038/s41598-021-98830-y ↗
40. Machine-learning based landslide susceptibility modelling with emphasis on uncertainty analysis10.1016/j.gsf.2023.101657 ↗
41. Mapping landslides from space: A review10.1007/s10346-024-02215-x ↗
42. How Do the Landslide and Non-Landslide Sampling Strategies Impact Landslide Susceptibility Assessment?—A Catchment-Scale Case Study from China10.1016/j.jrmge.2023.07.026 ↗
43. An objective absence data sampling method for landslide susceptibility mapping10.1038/s41598-023-28991-5 ↗
44. Effects of non-landslide sampling strategies on machine learning models in landslide susceptibility mapping10.1038/s41598-024-57964-5 ↗
45. Machine Learning-Based Landslide Susceptibility Assessment with Optimized Ratio of Landslide to Non-Landslide Samples10.1016/j.gr.2022.05.012 ↗
46. Influence of sampling design on landslide susceptibility modeling in lithologically heterogeneous areas10.1038/s41598-022-06257-w ↗
47. Enhancing Landslide Susceptibility Modelling through a Novel Non-Landslide Sampling Method and Ensemble Learning Technique10.1080/10106049.2024.2327463 ↗
48. Fu, Z., Wang, F., Dou, J., Nam, K., and Ma, H. (2023). Enhanced Absence Sampling Technique for Data-Driven Landslide Susceptibility Mapping: A Case Study in Songyang County, China. Remote Sens., 15.10.3390/rs15133345 ↗
49. Fu, Y., Fan, Z., Li, X., Wang, P., Sun, X., Ren, Y., and Cao, W. (2025). The Influence of Non-Landslide Sample Selection Methods on Landslide Susceptibility Prediction. Land, 14.10.3390/land14040722 ↗
50. Comparative study on landslide susceptibility mapping based on unbalanced sample ratio10.1038/s41598-023-33186-z ↗
51. Sample size effects on landslide susceptibility models: A comparative study of heuristic, statistical, machine learning, deep learning and ensemble learning models with SHAP analysis10.1016/j.cageo.2024.105723 ↗
52. Xu, Z., Wang, S., Yin, M., Zhang, X., Lu, Z., Yu, S., and Huang, J. (2025). Landslide susceptibility assessment via imbalanced data augmentation with tabular variational autoencoder and quality–diversity post-selection. Appl. Sci., 15.10.3390/app152211965 ↗
53. Estimating Global Landslide Susceptibility and Its Uncertainty through Ensemble Modeling10.5194/nhess-22-3063-2022 ↗
54. Uncertainty-Aware Ensemble Learning and Dynamic Threshold Optimization for Landslide Susceptibility Mapping10.1016/j.cageo.2025.106042 ↗
55. Landslide susceptibility maps of Italy: Lesson learnt from dealing with multiple landslide types and the uneven spatial distribution of the national inventory10.1016/j.earscirev.2022.104125 ↗
56. Random Forests10.1023/A:1010933404324 ↗
57. Random Forest in Remote Sensing: A Review of Applications and Future Directions10.1016/j.isprsjprs.2016.01.011 ↗
58. An Introduction to ROC Analysis10.1016/j.patrec.2005.10.010 ↗
59. Weighted kappa measures for ordinal multi-class classification performance10.1016/j.asoc.2023.110020 ↗
60. Evaluation metrics and statistical tests for machine learning10.1038/s41598-024-56706-x ↗
61. Effects of SBAS-InSAR Deformation Integration Methods and Machine Learning Model Selection on Landslide Susceptibility Mapping10.1109/ACCESS.2025.3576854 ↗
62. Improved Landslide Susceptibility Assessment: A New Negative Sample Collection Strategy and a Comparative Analysis of Zoning Methods10.1016/j.ecolind.2024.112948 ↗
63. Jiang, W., Li, L., and Niu, R. (2025). Impact of Non-Landslide Sample Sampling Strategies and Model Selection on Landslide Susceptibility Mapping. Appl. Sci., 15.10.3390/app15042132 ↗
64. Tu, L., Chen, M., Leng, P., Liu, S., Liu, M., Luo, W., and Mao, Y. (2025). Improving Landslide Susceptibility Assessment Through Non-Landslide Sampling Strategies. Land, 14.10.3390/land14102059 ↗
65. Considering the effect of non-landslide sample selection on landslide susceptibility assessment10.1080/19475705.2024.2392778 ↗
66. A frequency ratio–based sampling strategy for landslide susceptibility assessment10.1007/s10064-022-02836-3 ↗
67. Impact of negative sampling strategies on landslide susceptibility assessment10.1016/j.asr.2025.04.070 ↗
68. Zhao, L., Ma, H., Dong, J., Wu, X., Xu, H., and Niu, R. (2023). A Comparative Study of Landslide Susceptibility Mapping Using Bagging PU Learning in Class-Prior Probability Shift Datasets. Remote Sens., 15.10.3390/rs15235547 ↗
69. Wang, H., Wu, W., Yang, W., and Liu, M. (2024). Examining the Contribution of Lithology and Precipitation to the Performance of Earthquake-Induced Landslide Hazard Prediction. Front. Earth Sci., 12.10.3389/feart.2024.1431203 ↗
70. Li, M., and Tian, H. (2025). Insights from Optimized Non-Landslide Sampling and SHAP Explainability for Landslide Susceptibility Prediction. Appl. Sci., 15.10.3390/app15031163 ↗
71. Wu, X., Qi, X., Peng, B., and Wang, J. (2024). Optimized Landslide Susceptibility Mapping and Modelling Using the SBAS-InSAR Coupling Model. Remote Sens., 16.10.3390/rs16162873 ↗
72. Deng, J.-H., Guo, H.-Y., Cui, H.-Z., and Ji, J. (2025). Optimizing Landslide Susceptibility Mapping with Non-Landslide Sampling Strategy and Spatio-Temporal Fusion Models. Water, 17.10.3390/w17121778 ↗
73. Effects of Sampling Intensity and Non-Slide/Slide Sample Ratio on the Occurrence Probability of Coseismic Landslides10.1016/j.geomorph.2020.107222 ↗
74. Parsimonious high-resolution landslide susceptibility modeling at continental scales10.1029/2024AV001214 ↗