journal article·2025-02-21Open access

A Novel Pseudo-Siamese Fusion Network for Enhancing Semantic Segmentation of Building Areas in Synthetic Aperture Radar Images

Mengguang Liao, Longcheng Huang, Shaoning Li

Applied Sciences· Volume 15· Issue 5

Abstract

Segmenting building areas from synthetic aperture radar (SAR) images holds significant research value and practical application potential. However, the complexity of the environment, the diversity of building shapes, and the interference from speckle noise have made building area segmentation from SAR images a challenging research topic. Compared to traditional methods, deep learning-driven approaches exhibit superiority in the aspect of stability and efficiency. Currently, most segmentation methods use a single neural network to encode SAR images, then decode them through interpolation or transpose convolution operations, and finally obtain the segmented building area images using a loss function. Although effective, the methods result in the loss of detailed information and do not fully extract the deep-level features of building areas. Therefore, we propose an innovative network named PSANet. First, two sets of deep-level features of building areas were extracted using ResNet-18 and ResNet-34, with five encoded features of varying scales obtained through a fusion algorithm. Meanwhile, information on the deepest-level encoded features was enriched utilizing an atrous spatial pyramid pooling module. Next, the encoded features were reconstructed through skip connections and transposed convolution operations to obtain discriminative features of the building areas. Finally, the model was optimized using the combined CE-Dice loss function to achieve superior performance. The experimental results of the SAR images from regions with different geographical characteristics demonstrate that the proposed PSANet outperforms several recent State-of-the-Art methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Remote Sensing and Land Use · Automated Road and Building Extraction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Sanya Institute of Hunan University of Science and Technology, Sanya 572024, China

School of Earth Sciences and Spatial Information Engineering, Hunan University of Science and Technology, Xiangtan 411201, China

Funding

Natural Science Foundation of Hunan Province, China · Key Laboratory of Smart Earth, China · Scientific Research Fund of Hunan Provincial Education Department

References (42)

Show source-provided references
1. Guo, N., Jiang, M., Hu, X., Su, Z., Zhang, W., Li, R., and Luo, J. (2024). NPSFF-Net: Enhanced Building Segmentation in Remote Sensing Images via Novel Pseudo-Siamese Feature Fusion. Remote Sens., 16.10.3390/rs16173266 ↗
2. Cao, H., Zhang, H., Wang, C., and Zhang, B. (2018). Operational built-up areas extraction for cities in China using Sentinel-1 SAR data. Remote Sens., 10.10.3390/rs10060874 ↗
3. CG-Net: Conditional GIS-aware network for individual building segmentation in VHR SAR images
4. Building Damage Assessment Using High-Resolution Satellite SAR Images of the 2010 Haiti Earthquake10.1193/033014EQS042M ↗
5. Tan, C., Chen, T., Liu, J., Deng, X., Wang, H., and Ma, J. (2024). Building Extraction from Unmanned Aerial Vehicle (UAV) Data in a Landslide-Affected Scattered Mountainous Area Based on Res-Unet. Sustainability, 16.10.3390/su16229791 ↗
6. Semenzato, A., Pappalardo, S.E., Codato, D., Trivelloni, U., De Zorzi, S., Ferrari, S., De Marchi, M., and Massironi, M. (2020). Mapping and Monitoring Urban Environment through Sentinel-1 SAR Data: A Case Study in the Veneto Region (Italy). ISPRS Int. J. Geo Inf., 9.10.3390/ijgi9060375 ↗
7. Li, X., Yang, Y., Sun, C., and Fan, Y. (2024). Investigation, Evaluation, and Dynamic Monitoring of Traditional Chinese Village Buildings Based on Unmanned Aerial Vehicle Images and Deep Learning Methods. Sustainability, 16.10.3390/su16208954 ↗
8. Mapping and monitoring geological hazards using optical, LiDAR, and synthetic aperture RADAR image data10.1007/s11069-014-1122-7 ↗
9. Li, Y., Xu, W., Chen, H., Jiang, J., and Li, X. (2021). A novel framework based on mask R-CNN and histogram thresholding for scalable segmentation of new and old rural buildings. Remote Sens., 13.10.3390/rs13061070 ↗
10. Orhei, C., Vert, S., and Vasiu, R. (2020, January October). A novel edge detection operator for identifying buildings in augmented reality applications. Proceedings of the International Conference on Information and Software Technologies, Kaunas, Lithuania.10.1007/978-3-030-59506-7_18 ↗
11. Roof segmentation from airborne LiDAR using octree-based hybrid region growing and boundary neighborhood verification voting10.1109/JSTARS.2023.3244275 ↗
12. Chen, Y., Wang, Z., and Peng, Z. (2024). A Study on Carbon Emission Reduction in the Entire Process of Retrofitting High-Rise Office Buildings Based on the Extraction of Typical Models. Sustainability, 16.10.3390/su16198506 ↗
13. Muhammed, E., El-Shazly, A., and Morsy, S. (2023). Building Rooftop Extraction Using Machine Learning Algorithms for Solar Photovoltaic Potential Estimation. Sustainability, 15.10.3390/su151411004 ↗
14. Improved Random Forest for Classification10.1109/TIP.2018.2834830 ↗
15. Building Detection from Sar Images Using Unet Deep Learning Method10.5194/isprs-archives-XLIV-4-W3-2020-215-2020 ↗
16. Fine Building Segmentation in High-Resolution SAR Images via Selective Pyramid Dilated Network10.1109/JSTARS.2021.3076085 ↗
17. Peng, B., Zhang, W., Hu, Y., Chu, Q., and Li, Q. (2022). LRFFNet: Large Receptive Field Feature Fusion Network for Semantic Segmentation of SAR Images in Building Areas. Remote Sens., 14.10.3390/rs14246291 ↗
18. A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery10.1080/01431161.2018.1528024 ↗
19. Xiao, X., Guo, W., Chen, R., Hui, Y., Wang, J., and Zhao, H. (2022). A swin transformer-based encoding booster integrated in u-shaped network for building extraction. Remote Sens., 14.10.3390/rs14112611 ↗
20. Sariturk, B., and Seker, D.Z. (2022). A residual-inception U-Net (RIU-Net) approach and comparisons with U-shaped CNN and transformer models for building segmentation from high-resolution satellite images. Sensors, 22.10.3390/s22197624 ↗
21. Deep Biomedical Image Classification Using Diagonal Bilinear Interpolation and residual network
22. Gu, Y., Ren, C., Chen, Q., Bai, H., Huang, Z., and Zou, L. (2024). A Conditionally Parameterized Feature Fusion U-Net for Building Change Detection. Sustainability, 16.10.3390/su16219232 ↗
23. Pseudo-Siamese capsule network for aerial remote sensing images change detection
24. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
25. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
26. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
27. Generalized cross entropy loss for training deep neural networks with noisy labels
28. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
29. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
30. Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
31. Che, Z., Shen, L., Huo, L., Hu, C., Wang, Y., Lu, Y., and Bi, F. (2023). MAFF-HRNet: Multi-attention feature fusion HRNet for building segmentation in remote sensing images. Remote Sens., 15.10.3390/rs15051382 ↗
32. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested u-net architecture for medical image segmentation. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, DLMIA 2018, and 8th International Workshop, ML-CDS 2018, Held in Conjunction with MICCAI 2018, Granada, Spain.10.1007/978-3-030-00889-5_1 ↗
33. SegFormer: Simple and efficient design for semantic segmentation with transformers
34. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
35. Howard, A., Sandler, M., Chu, G., Chen, L.-C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
36. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
37. Park, J., Woo, S., Lee, J.-Y., and Kweon, I.S. (2018). Bam: Bottleneck attention module. arXiv.
38. Zhang, H., Zu, K., Lu, J., Zou, Y., and Meng, D. (2021). Epsanet: An efficient pyramid split attention block on convolutional neural network. arXiv.
39. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗
40. Ross, T.-Y., and Dollár, G. (2017, January 21–26). Focal loss for dense object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
41. A survey on transfer learning10.1109/TKDE.2009.191 ↗
42. Zhu, J.-Y., Park, T., Isola, P., and Efros, A.A. (2017, January 21–26). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Honolulu, HI, USA.10.1109/ICCV.2017.244 ↗