Open-Pit Mining Area Extraction Using Multispectral Remote Sensing Images: A Deep Learning Extraction Method Based on Transformer
Source abstract
Abstract
In the era of remote sensing big data, the intelligent interpretation of remote sensing images is a key technology for mining the value of remote sensing big data and promoting a number of major applications, mainly including land cover classification and extraction. Among these, the rapid extraction of open-pit mining areas plays a vital role in current practices for refined mineral resources development and management and ecological–environmental protection in China. However, existing methods are not accurate enough for classification, not fine enough for boundary extraction, and poor in terms of multi-scale adaptation. To address these issues, we propose a new semantic segmentation model based on Transformer, which is called Segmentation for Mine—SegMine—and consists of a Vision Transformer-based encoder and a lightweight attention mask decoder. The experimental results show that SegMine enhances the network’s ability to obtain local spatial detail information and improves the problem of disappearing small-scale object features and insufficient information expression. It also better preserves the boundary details of open-pit mining areas. Using the metrics of mIoU, precision, recall, and dice, experimental areas were selected for comparative analysis, and the results show that the new method is significantly better than six other existing major Transformer variants.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote-Sensing Image Classification · Geochemistry and Geologic Mapping · Mineral Processing and Grinding
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Natural Resources Survey and Monitoring Research Centre, Chinese Academy of Surveying and Mapping, Beijing 100830, China
School of Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, China
Guangxi Zhuang Autonomous Region Institute of Natural Resources Remote Sensing, Nanning 530201, China
Funding
Basic Scientific Research Operating Funds of the Chinese Academy of Surveying and Mapping
References (43)
Show source-provided references
1. Remote sensing of environment: History, philosophy, approach and contributions, 1969–201910.1016/j.rse.2019.111522 ↗
2. Tong, X.Y., Xia, G.S., Lu, Q., Shen, H., Li, S., You, S., and Zhang, L. (2022). Land-cover classification with high-resolution remote sensing images using transferable deep models. arXiv.
3. Deep learning for multi-modal classification of cloud, shadow and land cover scenes in PlanetScope and Sentinel-2 imagery10.1016/j.isprsjprs.2019.08.018 ↗
4. SO–CNN based urban functional zone fine division with VHR remote sensing image10.1016/j.rse.2019.111458 ↗
5. Implementation of machine-learning classification in remote sensing: An applied review10.1080/01431161.2018.1433343 ↗
6. Structural high-resolution satellite image indexing
7. Texture characterization using shape co-occurrence patterns10.1109/TIP.2017.2726182 ↗
8. Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification10.1016/j.isprsjprs.2018.01.023 ↗
9. HSF-Net: Multiscale deep feature embedding for ship detection in optical remote sensing imagery10.1109/TGRS.2018.2848901 ↗
10. Deep learning in remote sensing: A comprehensive review and list of resources10.1109/MGRS.2017.2762307 ↗
11. Deep learning and process understanding for data-driven Earth system science10.1038/s41586-019-0912-1 ↗
12. More diverse means better: Multimodal deep learning meets remote-sensing imagery classification10.1109/TGRS.2020.3016820 ↗
13. Multiscale U-shaped CNN building instance extraction framework with edge constraint for high-spatial-resolution remote sensing imagery10.1109/TGRS.2020.3022410 ↗
14. Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set10.1109/TGRS.2018.2858817 ↗
15. Belli, D., and Kipf, T. (2019). Image-conditioned graph generation for road network extraction. arXiv.
16. DeepWindow: Sliding window based on deep learning for road extraction from remote sensing images10.1109/JSTARS.2020.2983788 ↗
17. OpenStreetMap: Challenges and opportunities in machine learning and remote sensing
18. Multi-class geospatial object detection based on a position-sensitive balancing framework for high spatial resolution remote sensing imagery10.1016/j.isprsjprs.2018.02.014 ↗
19. Stability analysis of a deep and large open-pit based on fine geological modeling and large-scale parallel computing: A case study of Fushun West Open-pit Mine, Geomatics10.1080/19475705.2023.2266663 ↗
20. Scale Sequence Joint Deep Learning (SS-JDL) for land use and land cover classification10.1016/j.rse.2019.111593 ↗
21. Adaptive scale selection for multiscale segmentation of satellite images10.1109/JSTARS.2017.2693993 ↗
22. Deep learning-based remote and social sensing data fusion for urban region function recognition10.1016/j.isprsjprs.2020.02.014 ↗
23. Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning10.1016/j.isprsjprs.2018.04.014 ↗
24. Deep learning in remote sensing applications: A meta-analysis and review10.1016/j.isprsjprs.2019.04.015 ↗
25. Semantic segmentation of large-size VHR remote sensing images using a two-stage multiscale training architecture10.1109/TGRS.2020.2964675 ↗
26. Deep learning10.1038/nature14539 ↗
27. A patch-based convolutional neural network for remote sensing image classification10.1016/j.neunet.2017.07.017 ↗
28. Deep learning on edge: Extracting field boundaries from satellite images with a convolutional neural network10.1016/j.rse.2020.111741 ↗
29. Deep learning for processing and analysis of remote sensing big data: A technical review10.1080/20964471.2021.1964879 ↗
30. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
31. Bazi, Y., Bashmal, L., Al Rahhal, M.M., Al Dayil, R., and Al Ajlan, N. (2021). Vision transformers for remote sensing image classification. Remote Sens., 13.10.3390/rs13030516 ↗
32. Hao, S., Wu, B., Zhao, K., Ye, Y., and Wang, W. (2022). Two-stream swin transformer with differentiable sobel operator for remote sensing image classification. Remote Sens., 14.10.3390/rs14061507 ↗
33. Homo–heterogenous transformer learning framework for RS scene classification10.1109/JSTARS.2022.3155665 ↗
34. Spatio-temporal patterns of ecological capital under different mining intensities in an ecologically fragile mining area in Western China: A case study of Shenfu mining area
35. Change Detection of Mining Areas in Remote Sensing Imagery Based on Improved UNet Twin Networks
36. Wang, C., Chang, L., Zhao, L., and Niu, R. (2020). Automatic identification and dynamic monitoring of open-pit mines based on improved mask R-CNN and transfer learning. Remote Sens., 12.10.3390/rs12213474 ↗
37. Opencast mining area intelligent extraction method for multi-source remote sensing image based on improved densenet
38. Wang, J., Gou, C., Wu, Q., Feng, H., Han, J., Ding, E., and Wang, J. (2022). Rtformer: Efficient design for real-time semantic segmentation with transformer. arXiv.10.1109/APSIPAASC58517.2023.10317131 ↗
39. Strudel, R., Garcia, R., Laptev, I., and Schmid, C. (2021, January 11–17). Segmenter: Transformer for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00717 ↗
40. SegFormer: Simple and efficient design for semantic segmentation with transformers
41. Zhang, W., Huang, Z., Luo, G., Chen, T., Wang, X., Liu, W., Yu, G., and Shen, C. (2022, January 18–24). Topformer: Token pyramid transformer for mobile semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01177 ↗
42. Cheng, B., Misra, I., Schwing, A.G., Kirillov, A., and Girdhar, R. (2021). Masked-attention mask transformer for universal image segmentation. arXiv.10.1109/CVPR52688.2022.00135 ↗
43. Chen, Z., Duan, Y., Wang, W., He, J., Lu, T., Dai, J., and Qiao, Y. (2022). Vision transformer adapter for dense predictions. arXiv.