A Lightweight and Partitioned CNN Algorithm for Multi-Landslide Detection in Remote Sensing Images
Source abstract
Abstract
Landslide detection is crucial for natural disaster risk management. Deep-learning-based object-detection algorithms have been shown to be effective in landslide studies. However, advanced algorithms currently used for landslide detection require high computational complexity and memory requirements, limiting their practical applicability. In this study, we developed a high-resolution dataset for landslide-prone regions in China by extracting historical landslide remote sensing images from the Google Earth platform. We propose a lightweight LP-YOLO algorithm based on YOLOv5, with a more-lightweight backbone that incorporates our designed PartitionNet and neck equipped with CSPCrossStage. We constructed and added the vertical and horizontal (VH) block to the backbone, which explores and aggregates long-range information with two directions, while consuming a small amount of computational cost. A new feature fusion structure is proposed to boost information flow and enhance the location accuracy. To speed up the model learning process and improve the accuracy, the SCYLLA-IoU (SIoU) bounding box regression loss function was used to replace the complete IoU (CIoU) loss function. The experimental results demonstrated that our proposed model achieved the highest detection performance (53.7% of Precision, 49% of AP50 and 25.5% of AP50:95) with a speed of 74 fps. Compared to the YOLOv5 model, the proposed model achieved 4% improvement for Precision, 2.6% improvement for AP50, and 2.5% for AP50:95, while reducing the model parameters and FLOPs by 38.4% and 53.1%, respectively. The results indicated that the proposed lightweight method provides a technical guidance for achieving reliable and real-time automatic landslide detection and can be used for disaster prevention and mitigation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Landslides and related hazards · Anomaly Detection Techniques and Applications · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610059, China
References (45)
Show source-provided references
1. Interpretation of landslide distribution triggered by the 2005 Northern Pakistan earthquake using SPOT 5 imagery10.1007/s10346-006-0069-5 ↗
2. Sun, W., Tian, Y., Mu, X., Zhai, J., Gao, P., and Zhao, G. (2017). Loess landslide inventory map based on GF-1 satellite imagery. Remote Sens., 9.10.3390/rs9040314 ↗
3. Precursory Slope Deformation around Landslide Area Detected by Insar Throughout Japan10.5194/isprs-archives-XLI-B1-1201-2016 ↗
4. Use of a dark object concept and support vector machines to automate forest cover change analysis10.1016/j.rse.2007.07.023 ↗
5. Artificial neural networks and remote sensing10.1111/j.1749-8198.2008.00215.x ↗
6. Gorsevski, P.V., Gessler, P.E., and Jankowski, P. (2010). Handbook of Applied Spatial Analysis, Springer.
7. Convolutional neural networks for large-scale remote-sensing image classification10.1109/TGRS.2016.2612821 ↗
8. Random forests and evidential belief function-based landslide susceptibility assessment in Western Mazandaran Province, Iran10.1007/s12665-015-4950-1 ↗
9. Spatial prediction models for shallow landslide hazards: A comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic model tree10.1007/s10346-015-0557-6 ↗
10. Parallel binary image cryptosystem via spiking neural networks variants10.1142/S0129065721500143 ↗
11. Liu, H., Liu, M., Li, D., Zheng, W., Yin, L., and Wang, R. (2022). Recent advances in pulse-coupled neural networks with applications in image processing. Electronics, 11.10.3390/electronics11203264 ↗
12. Girshick, R. (2015, January 7–12). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Boston, MA, USA.10.1109/ICCV.2015.169 ↗
13. Faster r-cnn: Towards real-time object detection with region proposal networks
14. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the Computer Vision–ECCV 2016, 14th European Conference, Amsterdam, The Netherlands. Proceedings, Part I, No. 14.10.1007/978-3-319-46448-0_2 ↗
15. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
16. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000:better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
17. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
18. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
19. Ju, Y., Xu, Q., Jin, S., Li, W., Su, Y., Dong, X., and Guo, Q. (2022). Loess landslide detection using object-detection algorithms in northwest China. Remote Sens., 14.10.3390/rs14051182 ↗
20. Landslide detection from an open satellite imagery and digital elevation model dataset using attention boosted convolutional neural networks10.1007/s10346-020-01353-2 ↗
21. Hou, H., Chen, M., Tie, Y., and Li, W. (2022). A Universal Landslide Detection Method in Optical Remote Sensing Images Based on Improved YOLOX. Remote Sens., 14.10.3390/rs14194939 ↗
22. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
23. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding yolo series in 2021. arXiv.
24. Tang, X., Tu, Z., Wang, Y., Liu, M., Li, D., and Fan, X. (2022). Automatic detection of coseismic landslides using a new transformer method. Remote Sens., 14.10.3390/rs14122884 ↗
25. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., and Adam, H. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
26. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
27. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
28. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 8–14). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Munich, Germany.10.1109/CVPR.2018.00716 ↗
29. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 13–19). Ghostnet: More features from cheap operations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00165 ↗
30. Chen, J., Kao, S.H., He, H., Zhuo, W., Wen, S., Lee, C.H., and Chan, S.H.G. (2023). Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks. arXiv.10.1109/CVPR52729.2023.01157 ↗
31. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
32. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
33. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–23). Path aggregation network for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
34. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
35. Wang, C.Y., Liao, H.Y.M., Wu, Y.H., Chen, P.Y., Hsieh, J.W., and Yeh, I.H. (2020, January 13–19). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00203 ↗
36. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7–12). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6999 ↗
37. Sigmoid-weighted linear units for neural network function approximation in reinforcement learning10.1016/j.neunet.2017.12.012 ↗
38. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
39. Cross-srn: Structure-preserving super-resolution network with cross convolution10.1109/TCSVT.2021.3138431 ↗
40. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 16–20). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
41. Gevorgyan, Z. (2022). SIoU loss: More powerful learning for bounding box regression. arXiv.
42. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
43. Cui, C., Gao, T., Wei, S., Du, Y., Guo, R., Dong, S., and Ma, Y. (2021). PP-LCNet: A lightweight CPU convolutional neural network. arXiv.
44. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning (PMLR), Long Beach, CA, USA.
45. Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 20–25). Repvgg: Making vgg-style convnets great again. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01352 ↗