Transformer Self-Attention Change Detection Network with Frozen Parameters
Source abstract
Abstract
The purpose of change detection is to recognize changed areas from a pair of two remote sensing images. However, since change areas often include multiple terrain features, this demands enhanced feature extraction capability from the model. This paper proposes a frozen-parameter Transformer self-attention change detection network (ZAQNet). The network integrates four innovative modules: a GIAU (Generalized Image Attention Unit) which can effectively fuse the features of two remote sensing images and accurately focus on changing areas; a GSAU (Global Spatial Attention Unit) which performs self attention processing in the image spatial dimension to enhance the model’s ability to capture global change information; a GSCU (Global Semantic Context Unit) which performs self-attention operations in the channel dimension to enhance the model’s attention to feature maps containing changing information; and a PRU (Patch Refinement Unit) which extracts and refines spatial position information from the underlying feature map, optimizing the restoration effect of the feature map. The experiments on the BTRS-CD and LEVIR-CD datasets show that ZAQNet performs excellently in change detection tasks. Among them, the change detection index F1 and IOU are better than the comparison model. These results fully demonstrate the superiority, robustness, and generalization ability of ZAQNet in change detection tasks and provide an efficient and reliable solution for remote sensing image analysis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Applications · Remote-Sensing Image Classification · Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Collaborative Innovation Center on Atmospheric Environment and Equipment Technology, Nanjing University of Information Science and Technology, Nanjing 210044, China
College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China
Department of Computer Science, University of Reading, Whiteknights, Reading RG6 6DH, UK
Funding
National Natural Science Foundation of PR China
References (32)
Show source-provided references
1. Bitemporal Attention Sharing Network for Remote Sensing Image Change Detection10.1109/JSTARS.2024.3400925 ↗
2. Detecting land-use/land-cover change in rural–urban fringe areas using extended change-vector analysis
3. A comprehensive review of earthquake-induced building damage detection with remote sensing techniques10.1016/j.isprsjprs.2013.06.011 ↗
4. Land Cover classification and change-detection analysis using multi-temporal remote sensed imagery and landscape metrics10.5721/EuJRS20124501 ↗
5. Integration of remotely sensed spatial and spectral information for change detection using FAHP
6. Change detection in coastal zone environments
7. Detecting changes between optical images of different spatial and spectral resolutions: A fusion-based approach10.1109/TGRS.2017.2765348 ↗
8. Building change detection using high resolution remotely sensed data and GIS10.1109/JSTARS.2016.2542074 ↗
9. Unsupervised change detection in satellite images using principal component analysis and k-means clustering10.1109/LGRS.2009.2025059 ↗
10. Imagenet classification with deep convolutional neural networks
11. Change detection in synthetic aperture radar images based on deep neural networks10.1109/TNNLS.2015.2435783 ↗
12. Daudt, R.C., Le Saux, B., and Boulch, A. (2018, January 7–10). Fully convolutional siamese networks for change detection. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.
13. Attention is all you need
14. FTA-Net: Frequency-Temporal-Aware Network for Remote Sensing Change Detection10.1109/JSTARS.2025.3525595 ↗
15. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
16. Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., and Hu, H. (2022, January 18–24). Video swin transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00320 ↗
17. SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection10.1109/TGRS.2022.3221492 ↗
18. Peng, Z., Huang, W., Gu, S., Xie, L., Wang, Y., Jiao, J., and Ye, Q. (2021, January 10–17). Conformer: Local features coupling global representations for visual recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00042 ↗
19. Remote Sensing Image Change Detection With Transformers
20. Zhan, Z., Ren, H., Xia, M., Lin, H., Wang, X., and Li, X. (2024). AMFNet: Attention-Guided Multi-Scale Fusion Network for Bi-Temporal Change Detection in Remote Sensing Images. Remote Sens., 16.10.3390/rs16101765 ↗
21. TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images
22. Jiang, S., Lin, H., Ren, H., Hu, Z., Weng, L., and Xia, M. (2024). MDANet: A High-Resolution City Change Detection Network Based on Difference and Attention Mechanisms under Multi-Scale Feature Fusion. Remote Sens., 16.10.3390/rs16081387 ↗
23. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
24. Chen, H., and Shi, Z. (2020). A spatial-temporal attention-based method and a new dataset for remote sensing image change detection. Remote Sens., 12.10.3390/rs12101662 ↗
25. Qian, J., Xia, M., Zhang, Y., Liu, J., and Xu, Y. (2020). Tcdnet: Trilateral change detection network for google earth image. Remote Sens., 12.10.3390/rs12172669 ↗
26. SNUNet-CD: A densely connected Siamese network for change detection of VHR images
27. MFGAN: Multi-modal feature-fusion for CT metal artifact reduction using GANs10.1145/3599730 ↗
28. STA-Net: Spatial-temporal attention network for video salient object detection10.1007/s10489-020-01961-4 ↗
29. DASNet: Dual attentive fully convolutional Siamese networks for change detection in high-resolution satellite images10.1109/JSTARS.2020.3037893 ↗
30. Remote sensing change detection via temporal feature interaction and guided refinement
31. Varghese, A., Gubbi, J., Ramaswamy, A., and Balamuralidhar, P. (2018, January 8–14). ChangeNet: A deep learning architecture for visual change detection. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11012-3_10 ↗
32. Bandara, W.G.C., and Patel, V.M. (2022, January 17–22). A transformer-based siamese network for change detection. Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia.10.1109/IGARSS46834.2022.9883686 ↗