journal article·2025-03-21Open access

Siamese-SAM: Remote Sensing Image Change Detection with Siamese Structure Segment Anything Model

Gang Wei, Yuqi Miao, Zhicheng Wang

Applied Sciences· Volume 15· Issue 7

Abstract

Change detection in remote sensing images is a critical task that requires effectively capturing both global and differential information between bitemporal or more images. Recent progress in foundational vision models, like the Segment Anything Model (SAM), has led to significant improvements in feature extraction. However, these models do not have specific mechanisms designed to effectively utilize global and differential information for change detection tasks. To address this limitation, we propose Siamese-SAM, a novel Siamese network incorporating SAM as the encoder for each input image. To enhance feature representations, we introduce three specialized modules: the Global Information Enhancement Module (GIEM) to refine global representations, the Differential Information Enhancement Module (DIEM) to emphasize differential features, and the Differential Global Information Fusion Module (DGIF) to integrate global and differential information effectively. Our model is evaluated on three benchmark datasets: LEVIR-CD, SYSU-CD, and GZ-CD, achieving state-of-the-art performance. Specifically, Siamese-SAM attains F1 scores of 92.67%, 82.61%, and 88.79% and IoU scores of 86.34%, 70.17%, and 79.83%, respectively, outperforming conventional approaches.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Remote Sensing and Land Use · Geochemistry and Geologic Mapping

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

CAD Research Center, Tongji University, Shanghai 201804, China

References (57)

Show source-provided references
1. Digital Change Detection Techniques Using Remotely-Sensed Data10.1080/01431168908903939 ↗
2. Huang, Z., Cao, C., Chen, W., Xu, M., Dang, Y., Singh, R.P., Bashir, B., Xie, B., and Lin, X. (2020). Remote Sensing Monitoring of Vegetation Dynamic Changes after Fire in the Greater Hinggan Mountain Area: The Algorithm and Application for Eliminating Phenological Impacts. Remote Sens., 12.10.3390/rs12010156 ↗
3. Mashala, M.J., Dube, T., Mudereri, B.T., Ayisi, K.K., and Ramudzuli, M.R. (2023). A Systematic Review on Advancements in Remote Sensing for Assessing and Monitoring Land Use and Land Cover Changes Impacts on Surface Water Resources in Semi-Arid Tropical Environments. Remote Sens., 15.10.3390/rs15163926 ↗
4. Han, D., Yang, G., Lu, W., Huang, M., and Liu, S. (2024). A Multi-Level Damage Assessment Model Based on Change Detection Technology in Remote Sensing Images. Nat. Hazards.10.1007/s11069-024-07094-y ↗
5. Analysis on Change Detection Techniques for Remote Sensing Applications: A Review10.1016/j.ecoinf.2021.101310 ↗
6. Change Detection in Urban Areas Using Satellite Data
7. Remote Sensing Change Detection for Ecological Monitoring in United States Protected Areas10.1016/j.biocon.2014.12.006 ↗
8. Cheng, G., Huang, Y., Li, X., Lyu, S., Xu, Z., Zhao, H., Zhao, Q., and Xiang, S. (2024). Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Review. Remote Sens., 16.10.3390/rs16132355 ↗
9. Bandara, W.G.C., and Patel, V.M. (2022, January 17–22). A Transformer-Based Siamese Network for Change Detection. Proceedings of the IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia.10.1109/IGARSS46834.2022.9883686 ↗
10. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023, January 1–6). Segment Anything. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00371 ↗
11. Zhang, C., Liu, L., Cui, Y., Huang, G., Lin, W., Yang, Y., and Hu, Y. (2023). A Comprehensive Survey on Segment Anything Model for Vision and Beyond. arXiv.
12. Jiang, H., Peng, M., Zhong, Y., Xie, H., Hao, Z., Lin, J., Ma, X., and Hu, X. (2022). A Survey on Deep Learning-Based Change Detection from High-Resolution Remote Sensing Images. Remote Sens., 14.10.3390/rs14071552 ↗
13. Segment Anything Is Not Always Perfect: An Investigation of SAM on Different Real-World Applications10.1007/s11633-023-1385-0 ↗
14. Remote Sensing Image Scene Classification: Advances and Open Challenges10.3390/geomatics3010007 ↗
15. Change detection in coastal zone environments
16. Li, L., Li, X., Zhang, Y., Wang, L., and Ying, G. (2016, January 10–15). Change detection for high-resolution remote sensing imagery using object-oriented change vector analysis method. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.10.1109/IGARSS.2016.7729742 ↗
17. Vu, P.X., Duc, N.T., and Yem, V.V. (2015, January 28–30). Application of Statistical Models for Change Detection in SAR Imagery. Proceedings of the 2015 International Conference on Computing, Management and Telecommunications, ComManTel 2015, Da Nang, Vietnam.10.1109/ComManTel.2015.7394295 ↗
18. Zhao, J., Chang, Y., Yang, J., Niu, Y., Lu, Z., and Li, P. (2020). A Novel Change Detection Method Based on Statistical Distribution Characteristics Using Multi-Temporal PolSAR Data. Sensors, 20.10.3390/s20051508 ↗
19. Raj, J.R., and Srinivasulu, S. (2020, January 6–7). Change detection of images based on multivariate alteration detection method. Proceedings of the 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.10.1109/ICACCS48705.2020.9074298 ↗
20. An improved change detection approach using tri-temporal logic-verified change vector analysis10.1016/j.isprsjprs.2020.01.026 ↗
21. Landslide mapping from aerial photographs using change detection-based Markov random field10.1016/j.rse.2016.10.008 ↗
22. Multimodal Change Detection in Remote Sensing Images Using an Unsupervised Pixel Pairwise-Based Markov Random Field Model10.1109/TIP.2019.2933747 ↗
23. Bromley, J., Guyon, I., LeCun, Y., Säckinger, E., and Shah, R. (December, January 29). Signature Verification Using a “Siamese” Time Delay Neural Network. Proceedings of the 7th International Conference on Neural Information Processing Systems, Denver, CO, USA.
24. A Review of Multi-Class Change Detection for Satellite Remote Sensing Imagery10.1080/10095020.2022.2128902 ↗
25. You, Y., Cao, J., and Zhou, W. (2020). A Survey of Change Detection Methods Based on Remote Sensing Images for Multi-Source and Multi-Objective Scenarios. Remote Sens., 12.10.3390/rs12152460 ↗
26. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
27. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III.10.1007/978-3-319-24574-4_28 ↗
28. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
29. SNUNet-CD: A densely connected Siamese network for change detection of VHR images
30. LSKNet: A Foundation Lightweight Backbone for Remote Sensing10.1007/s11263-024-02247-9 ↗
31. Multi-Granularity Siamese Transformer-Based Change Detection in Remote Sensing Imagery10.1016/j.engappai.2024.108960 ↗
32. Remote Sensing Image Change Detection with Transformers
33. Wang, G., Li, B., Zhang, T., and Zhang, S. (2022). A Network Combining a Transformer and a Convolutional Neural Network for Remote Sensing Image Change Detection. Remote Sens., 14.10.3390/rs14092228 ↗
34. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
35. SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection10.1109/TGRS.2022.3221492 ↗
36. Yan, T., Wan, Z., and Zhang, P. (2022, January 4–8). Fully transformer network for change detection of remote sensing images. Proceedings of the Asian Conference on Computer Vision, Macau, China.
37. Zhao, X., Ding, W., An, Y., Du, Y., Yu, T., Li, M., Tang, M., and Wang, J. (2023). Fast Segment Anything. arXiv.
38. Adapting Segment Anything Model for Change Detection in VHR Remote Sensing Images
39. Zhao, H., Kong, X., He, J., Qiao, Y., and Dong, C. (2020, January 23–28). Efficient Image Super-Resolution Using Pixel Attention. Proceedings of the Computer Vision–ECCV 2020 Workshops, Glasgow, UK. Proceedings, Part III.10.1007/978-3-030-67070-2_3 ↗
40. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
41. Hua, B.-S., Tran, M.-K., and Yeung, S.-K. (2018, January 18–23). Pointwise Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00109 ↗
42. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
43. Chen, H., and Shi, Z. (2020). A spatial-temporal attention-based method and a new dataset for remote sensing image change detection. Remote Sens., 12.10.3390/rs12101662 ↗
44. A deeply supervised attention metric-based network and an open aerial image dataset for remote sensing change detection
45. SemiCDNet: A Semisupervised Convolutional Neural Network for Change Detection in High Resolution Remote-Sensing Images10.1109/TGRS.2020.3011913 ↗
46. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15–20). Generalized Intersection over Union: A Metric and a Loss for Bounding Box Regression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
47. Song, C., Yang, M., Qi, H., and Li, S. (2009, January 7–9). A Kappa Measurement of Query Consistency and Its Application. Proceedings of the 2009 International Conference on Asian Language Processing, Singapore.10.1109/IALP.2009.70 ↗
48. Loshchilov, I., and Hutter, F. (2016). SGDR: Stochastic Gradient Descent with Warm Restarts. arXiv.
49. Daudt, R.C., Le Saux, B., and Boulch, A. (2018, January 7–10). Fully Convolutional Siamese Networks for Change Detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.
50. Varghese, A., Gubbi, J., Ramaswamy, A., and Balamuralidhar, P. (2018, January 8–14). ChangeNet: A deep learning architecture for visual change detection. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11012-3_10 ↗
51. Attention-guided siamese networks for change detection in high resolution remote sensing images
52. Zhan, Z., Ren, H., Xia, M., Lin, H., Wang, X., and Li, X. (2024). AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images. Remote Sens., 16.10.3390/rs16101765 ↗
53. Bitemporal Attention Sharing Network for Remote Sensing Image Change Detection10.1109/JSTARS.2024.3400925 ↗
54. Jiang, S., Lin, H., Ren, H., Hu, Z., Weng, L., and Xia, M. (2024). MDANet: A High-Resolution City Change Detection Network Based on Difference and Attention Mechanisms under Multi-Scale Feature Fusion. Remote Sens., 16.10.3390/rs16081387 ↗
55. Multi-Supervised Feature Fusion Attention Network for Clouds and Shadows Detection10.3390/ijgi12060247 ↗
56. HyCloudX: A Multibranch Hybrid Segmentation Network with Band Fusion for Cloud/Shadow10.1109/JSTARS.2024.3374233 ↗
57. FTA-Net: Frequency-Temporal-Aware Network for Remote Sensing Change Detection10.1109/JSTARS.2025.3525595 ↗