journal article·2026-01-09Open access

Research on Remote Sensing Image Object Segmentation Using a Hybrid Multi-Attention Mechanism

Lei Chen, Changliang Li, Yixuan Gao, Yujie Chang, Siming Jin, Zhipeng Wang, Xiaoping Ma, Limin Jia

Applied Sciences· Volume 16· Issue 2

Abstract

High-resolution remote sensing images are gradually playing an important role in land cover mapping, urban planning, and environmental monitoring tasks. However, current segmentation approaches frequently encounter challenges such as loss of detail and blurred boundaries when processing high-resolution remote sensing imagery, owing to their complex backgrounds and dense semantic content. In response to the aforementioned limitations, this study introduces HMA-UNet, a novel segmentation network built upon the UNet framework and enhanced through a hybrid attention strategy. The architecture’s innovation centers on a composite attention block, where a lightweight split fusion attention (LSFA) mechanism and a lightweight channel-spatial attention (LCSA) mechanism are synergistically integrated within a residual learning structure to replace the stacked convolutional structure in UNet, which can improve the utilization of important shallow features and eliminate redundant information interference. Comprehensive experiments on the WHDLD dataset and the DeepGlobe road extraction dataset show that our proposed method achieves effective segmentation in remote sensing images by fully utilizing shallow features and eliminating redundant information interference. The quantitative evaluation results demonstrate the performance of the proposed method across two benchmark datasets. On the WHDLD dataset, the model attains a mean accuracy, IoU, precision, and recall of 72.40%, 60.71%, 75.46%, and 72.41%, respectively. Correspondingly, on the DeepGlobe road extraction dataset, it achieves a mean accuracy of 57.87%, an mIoU of 49.82%, a mean precision of 78.18%, and a mean recall of 57.87%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Automated Road and Building Extraction · Advanced Neural Network Applications · Remote-Sensing Image Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Traffic and Transportation, Beijing Jiaotong University, Beijing 100044, China

Innovation Center on Intelligent Collaboration of Satellites and Cloud, CASIC Space Engineering Development Co., Ltd., Beijing 100854, China

Funding

the Program of Safety Assurance Technology for Energy Transport Corridor of Shuohuang Railway Based on Advanced Sensing Technologies

References (44)

Show source-provided references
1. Kim, M., and Kim, G. (2022). Modeling and Predicting Urban Expansion in South Korea Using Explainable Artificial Intelligence (XAI) Model. Appl. Sci., 12.10.3390/app12189169 ↗
2. Liu, J., Ran, X., and Wang, X. (2026). Intelligent Landslide Susceptibility Assessment Framework Using the Swin Transformer Technique: A Case Study of Changbai County, Jilin Province, China. Appl. Sci., 16.10.3390/app16010301 ↗
3. Estimating Traffic in Urban Areas from Very-High Resolution Aerial Images10.1080/01431161.2020.1815891 ↗
4. Feng, Y., Chen, B., Liu, W., Xue, X., Liu, T., Zhu, L., and Xing, H. (2024). Winter Wheat Mapping in Shandong Province of China with Multi-Temporal Sentinel-2 Images. Appl. Sci., 14.10.3390/app14093940 ↗
5. Extraction of Coastline in Aquaculture Coast from Multispectral Remote Sensing Images: Object-Based Region Growing Integrating Edge Detection10.3390/rs5094470 ↗
6. A Comprehensive Survey of Multi-Level Thresholding Segmentation Methods for Image Processing10.1007/s11831-024-10093-8 ↗
7. Remote Sensing Image Classification: A survey of support-vector-machine-based advanced techniques10.1109/MGRS.2016.2641240 ↗
8. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
9. Tang, W., and Li, H. (2024). Robust Airport Surface Object Detection Based on Graph Neural Network. Appl. Sci., 14.10.3390/app14093555 ↗
10. Gui, S., Song, S., Qin, R., and Tang, Y. (2024). Remote Sensing Object Detection in the Deep Learning Era—A Review. Remote Sens., 16.10.3390/rs16020327 ↗
11. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
12. Remote Sensing Object Detection Meets Deep Learning: A metareview of challenges and advances10.1109/MGRS.2023.3312347 ↗
13. Li, Z., Wang, Y., Zhang, N., Zhang, Y., Zhao, Z., Xu, D., Ben, G., and Gao, Y. (2022). Deep Learning-Based Object Detection Techniques for Remote Sensing Images: A Survey. Remote Sens., 14.10.3390/rs14102385 ↗
14. ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data10.1016/j.isprsjprs.2020.01.013 ↗
15. Khan, B.A., and Jung, J.-W. (2024). Semantic Segmentation of Aerial Imagery Using U-Net with Self-Attention and Separable Convolutions. Appl. Sci., 14.10.3390/app14093712 ↗
16. Deep-Learning-Based Semantic Segmentation of Remote Sensing Images: A Survey10.1109/JSTARS.2023.3335891 ↗
17. A review of deep learning methods for semantic segmentation of remote sensing imagery10.1016/j.eswa.2020.114417 ↗
18. Lv, J., Shen, Q., Lv, M., Li, Y., Shi, L., and Zhang, P. (2023). Deep learning-based semantic segmentation of remote sensing images: A review. Front. Ecol. Evol., 11.10.3389/fevo.2023.1201125 ↗
19. Li, J., Pei, Y., Zhao, S., Xiao, R., Sang, X., and Zhang, C. (2020). A Review of Remote Sensing for Environmental Monitoring in China. Remote Sens., 12.10.3390/rs12071130 ↗
20. Fully Convolutional Networks for Semantic Segmentation10.1109/TPAMI.2016.2572683 ↗
21. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation, Springer International Publishing.10.1007/978-3-319-24574-4_28 ↗
22. Chang, Z., Li, H., Chen, D., Liu, Y., Zou, C., Chen, J., Han, W., Liu, S., and Zhang, N. (2023). Crop Type Identification Using High-Resolution Remote Sensing Images Based on an Improved DeepLabV3+ Network. Remote Sens., 15.10.3390/rs15215088 ↗
23. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation10.1109/TPAMI.2016.2644615 ↗
24. Multiscale feature U-Net for remote sensing image segmentation10.1117/1.JRS.16.016507 ↗
25. DenseU-Net-Based Semantic Segmentation of Small Objects in Urban Remote Sensing Images10.1109/ACCESS.2019.2917952 ↗
26. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
27. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the Computer Vision—ECCV 2018, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
28. Park, J., Woo, S., Lee, J.-Y., and Kweon, I.S. (2018). Bam: Bottleneck attention module. arXiv.
29. Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 16–20). Selective kernel networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00060 ↗
30. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local Neural Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
31. Oktay, O., Schlemper, J., Folgoc, L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv.
32. MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images
33. Lu, M., Zhang, Y., Du, X., Chen, T., Liu, S., and Lei, T. (2021). Attention-Based DSM Fusion Network for Semantic Segmentation of High-Resolution Remote-Sensing Images, Springer International Publishing.10.1007/978-3-030-70665-4_67 ↗
34. Khanh, T., Duy Phuong, D., Ho, N.-H., Yang, H.-J., Baek, E.-T., Lee, G., Kim, S.H., and Yoo, S. (2020). Enhancing U-Net with Spatial-Channel Attention Gate for Abnormal Tissue Segmentation in Medical Imaging. Appl. Sci., 10.10.3390/app10175729 ↗
35. Multistage Attention ResU-Net for Semantic Segmentation of Fine-Resolution Remote Sensing Images
36. Yu, M., Chen, X., Zhang, W., and Liu, Y. (2022). AGs-Unet: Building Extraction Model for High Resolution Remote Sensing Images Based on Attention Gates U Network. Sensors, 22.10.3390/s22082932 ↗
37. HA U-Net: Improved Model for Building Extraction From High Resolution Remote Sensing Imagery10.1109/ACCESS.2021.3097630 ↗
38. Multilabel Remote Sensing Image Retrieval Based on Fully Convolutional Network10.1109/JSTARS.2019.2961634 ↗
39. Demir, I., Koperski, K., Lindenbaum, D., Pang, G., Huang, J., Basu, S., Hughes, F., Tuia, D., and Raskar, R. (2018, January 18–22). DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA.10.1109/CVPRW.2018.00031 ↗
40. Deep high-resolution representation learning for visual recognition10.1109/TPAMI.2020.2983686 ↗
41. Deep Learning-Based Road Extraction From Historical Maps
42. CellSegUNet: An improved deep segmentation model for the cell segmentation based on UNet++ and residual UNet models10.1007/s00521-023-09374-3 ↗
43. Gong, Z., Wei, Z., Wang, D., Hu, X., Ma, X., Chen, H., Jia, Y., Deng, Y., Ji, Z., and Zhu, X. (2024). Crossearth: Geospatial vision foundation model for domain generalizable remote sensing semantic segmentation. arXiv.10.1109/TPAMI.2025.3649001 ↗
44. Multi-scale spatial pyramid attention mechanism for image recognition: An effective approach10.1016/j.engappai.2024.108261 ↗