journal article·2026-04-25Open access

Hierarchical Classification of Erosion Gullies and Interpretation of Influencing Factors Based on Random Forest and SHAP

Miao Wang, Fukun Wang, Mingwei Hai, Yong Liu, Chunjiao Wang, Fuhui Xiong

Applied Sciences· Volume 16· Issue 9

Abstract

This study aimed to enhance the accuracy and interpretability of erosion gully classification within black soil regions by focusing on Changxing Township, Xinxing District, Qitaihe City, Heilongjiang Province as the research site. Utilizing RTK (Real-Time Kinematic) surveying technology, three-dimensional topographic data were collected for 139 actively developing erosion gullies. Key morphological parameters—including gully length, depth, gradient, average top width, average bottom width, and slope gradients on both sides—were extracted to construct interactive features. The variable set was refined through correlation analysis and variance inflation factor (VIF) diagnostics to mitigate multicollinearity. A random forest model was employed as the primary classification approach and benchmarked against logistic regression, support vector machines (SVM), decision trees, and backpropagation neural networks. To address class imbalance, a combination of class weighting, Synthetic Minority Over-sampling Technique (SMOTE), and undersampling methods was implemented. Model tuning and interpretability assessments were performed using cross-validation, grid search optimization, and SHapley Additive exPlanations (SHAP) analysis. The findings demonstrate that the random forest model achieved superior overall performance, with test set accuracy, macro-averaged F1 score, and balanced accuracy values of 0.9143, 0.8087, and 0.8427, respectively. Among imbalance handling techniques, class weighting yielded better results compared to oversampling and undersampling. Feature importance and SHAP analyses identified gully length, average crest width, and their interaction with gully depth as the principal determinants influencing gully grade classification. These results elucidate the synergistic developmental dynamics of gully longitudinal extension, vertical deepening, and lateral widening. The proposed methodology offers valuable technical support for the rapid surveying, classification, and management decision-making processes related to black soil erosion gullies.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Soil erosion and sediment transport · Groundwater and Watershed Analysis · Flood Risk Assessment and Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Heilongjiang Province Hydraulic Research Institute, Harbin 150050, China

Key Laboratory of Earthquake Engineering and Engineering Vibration, Institute of Engineering Mechanics, China Earthquake Administration, Harbin 150080, China

College of Water Conservancy and Civil Engineering, Northeast Agricultural University, Harbin 150030, China

Funding

National Natural Science Foundation of China · Heilongjiang Provincial Natural Science Foundation of China

References (43)

Show source-provided references
1. A century of gully erosion research: Urgency, complexity and study approaches10.1016/j.earscirev.2016.07.009 ↗
2. Measuring, modeling, and managing gully erosion at large scales: A state of the art10.1016/j.earscirev.2021.103637 ↗
3. How fast do gully headcuts retreat?10.1016/j.earscirev.2016.01.009 ↗
4. An assessment of the global impact of 21st century land use change on soil erosion10.1038/s41467-017-02142-7 ↗
5. Soil erosion in the Anthropocene: Research needs10.1002/esp.4250 ↗
6. Forum paper: The significance of soils and soil science toward the realization of the UN Sustainable Development Goals (SDGs)
7. Wang, F. (2024). Preliminary Study on the Characteristics and Control Concepts of Erosion Gullies in Cold Black Soil Regions, Institute of Engineering Mechanics, China Earthquake Administration.
8. Gully erosion susceptibility maps and influence factor analysis in the Lhasa River Basin on the Tibetan Plateau, based on machine learning algorithms10.1016/j.catena.2023.107695 ↗
9. The potential of 3D gully monitoring with GIS using high-resolution aerial photography and a digital photogrammetry system10.1016/j.geomorph.2008.05.047 ↗
10. Remote sensing image segmentation of gully erosion in a typical black soil area in Northeast China based on an improved DeepLabV3+ model10.1016/j.ecoinf.2024.102929 ↗
11. Automated gully erosion extraction in the typical black soil region of Northeast China using a deep learning approach based on multi-source remote sensing data10.1016/j.catena.2025.109748 ↗
12. Extracting gullies using machine learning and deep learning algorithms in the loess hilly and gully region of China10.1016/j.iswcr.2025.10.003 ↗
13. Mohebzadeh, H., Biswas, A., Rudra, R., and Daggupati, P. (2022). Machine learning techniques for gully erosion susceptibility mapping: A review. Geosciences, 12.10.3390/geosciences12120429 ↗
14. Arabameri, A., Tiefenbacher, J.P., Blaschke, T., Pradhan, B., and Bui, D.T. (2020). Morphometric analysis for soil erosion susceptibility mapping using a novel GIS-based ensemble model. Remote Sens., 12.10.3390/rs12050874 ↗
15. Assessment of gully erosion susceptibility using different DEM-derived topographic factors in the black soil region of Northeast China10.1016/j.iswcr.2022.04.001 ↗
16. Gully erosion susceptibility assessment using different machine learning algorithms: A case study of the Shazand Watershed in Iran10.1007/s10666-023-09910-4 ↗
17. Gully erosion susceptibility assessment using three machine learning models in the black soil region of Northeast China10.1016/j.catena.2024.108275 ↗
18. Gully erosion susceptibility assessment and SHAP interpretability analysis in sloping farmland of soil-rock dual structure area: A case study of Yimeng Mountain area, China10.1016/j.geomorph.2025.110146 ↗
19. Random forests10.1023/A:1010933404324 ↗
20. Random forest in remote sensing: A review of applications and future directions10.1016/j.isprsjprs.2016.01.011 ↗
21. A random forest guided tour10.1007/s11749-016-0481-7 ↗
22. Implementation of machine-learning classification in remote sensing: An applied review10.1080/01431161.2018.1433343 ↗
23. Li, H., Jin, J., Dong, F., Zhang, J., Li, L., and Zhang, Y. (2024). Gully erosion susceptibility prediction using high-resolution data: Evaluation, comparison, and improvement of multiple machine learning models. Remote Sens., 16.10.3390/rs16244742 ↗
24. All models are wrong, but many are useful: Learning a variable’s importance by studying an entire class of prediction models simultaneously
25. The revival of the Gini importance?10.1093/bioinformatics/bty373 ↗
26. Visualizing the effects of predictor variables in black-box supervised learning models10.1111/rssb.12377 ↗
27. Lundberg, S.M., and Lee, S.I. (2017, January 4–9). A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
28. From local explanations to global understanding with explainable AI for trees10.1038/s42256-019-0138-9 ↗
29. Study on an interpretable prediction model for pile bearing capacity based on SHAP and BP neural networks10.1038/s41598-025-13616-w ↗
30. Wang, N., Zhang, H., Dahal, A., Cheng, W., Zhao, M., and Lombardo, L. (2024). On the use of explainable AI for susceptibility modeling: Examining the spatial pattern of SHAP values. Geosci. Front., 15.10.1016/j.gsf.2024.101800 ↗
31. Interpretable machine learning for weather and climate prediction: A review10.1016/j.atmosenv.2024.120797 ↗
32. Interpreting machine learning models based on SHAP values in predicting suspended sediment concentration10.1016/j.ijsrc.2024.10.002 ↗
33. Enhancing Soil Water Prediction in Arid Climates Using Multipredictor Machine-Learning Models and SHAP-Based Interpretability10.1061/JIDEDH.IRENG-10619 ↗
34. Multiple spatio-temporal scale runoff forecasting and driving mechanism exploration using K-means optimized XGBoost and SHAP10.1016/j.jhydrol.2024.130650 ↗
35. An explainable machine learning approach (SHAP) to assessing desertification risk and its drivers in the Ring-Tarim Basin, 1990–202010.1016/j.eiar.2025.108309 ↗
36. Failure mode and effects analysis of RC members based on the machine-learning-based Shapley Additive Explanations (SHAP) approach10.1016/j.engstruct.2020.110927 ↗
37. Impact of road transport system on groundwater quality inferred from explainable artificial intelligence (XAI)10.1016/j.scitotenv.2024.170388 ↗
38. Maurya, R., Saha, S., Misra, B., Chatterjee, D., Chakraborty, S., and Sarkar, P. (2025, January 18–19). Employing Explainable Artificial Intelligence (XAI) for Enhanced Water Quality Assessment. Proceedings of the 2025 International Conference on Computing, Intelligence, and Application (CIACON), Durgapur, India.10.1109/CIACON65473.2025.11189765 ↗
39. Explainable machine learning with ensemble-based uncertainty quantification for groundwater quality indices in the Ganfu Plain, China10.1007/s12665-026-12933-1 ↗
40. Estimating the water quality index based on interpretable machine learning models10.2166/wst.2024.068 ↗
41. Predicting water quality index using stacked ensemble regression and SHAP based explainable artificial intelligence10.1038/s41598-025-09463-4 ↗
42. Explainable machine learning reveals drivers of ecological quality in a karst watershed: Implications for sustainable management of the Mawei river basin, China10.1080/17538947.2025.2600876 ↗
43. Evaluation of water quality indexes with novel machine learning and SHapley Additive ExPlanation (SHAP) approaches10.1016/j.jwpe.2024.104789 ↗