MSGATN: A Superpixel-Based Multi-Scale Siamese Graph Attention Network for Change Detection in Remote Sensing Images
Source abstract
Abstract
With the rapid development of Earth observation technology, how to effectively and efficiently detect changes in multi-temporal images has become an important but challenging problem. Relying on the advantages of high performance and robustness, object-based change detection (CD) has become increasingly popular. By analyzing the similarity of local pixels, object-based CD aggregates similar pixels into one object and takes it as the basic processing unit. However, object-based approaches often have difficulty capturing discriminative features, as irregular objects make processing difficult. To address this problem, in this paper, we propose a novel superpixel-based multi-scale Siamese graph attention network (MSGATN) which can process unstructured data natively and extract valuable features. First, a difference image (DI) is generated by Euclidean distance between bitemporal images. Second, superpixel segmentation is employed based on DI to divide each image into many homogeneous regions. Then, these superpixels are used to model the problem by graph theory to construct a series of nodes with the adjacency between them. Subsequently, the multi-scale neighborhood features of the nodes are extracted through applying a graph convolutional network and concatenated by an attention mechanism. Finally, the binary change map can be obtained by classifying each node by some fully connected layers. The novel features of MSGATN can be summarized as follows: (1) Training in multi-scale constructed graphs improves the recognition over changed land cover of varied sizes and shapes. (2) Spectral and spatial self-attention mechanisms are exploited for a better change detection performance. The experimental results on several real datasets show the effectiveness and superiority of the proposed method. In addition, compared to other recent methods, the proposed can demonstrate very high processing efficiency and greatly reduce the dependence on labeled training samples in a semisupervised training fashion.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote-Sensing Image Classification · Remote Sensing and Land Use · Remote Sensing in Agriculture
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic Engineering, Xidian University, Xi’an 710121, China
Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Electronic Engineering, Xidian University, Xi’an 710071, China
Funding
National Natural Science Foundation of China
References (66)
Show source-provided references
1. Training Samples Enriching Approach for Classification Improvement of VHR Remote Sensing Image
2. A Two-Step Method for Remote Sensing Images Registration Based on Local and Global Constraints10.1109/JSTARS.2021.3079103 ↗
3. A novel point-matching algorithm based on fast sample consensus for image registration10.1109/LGRS.2014.2325970 ↗
4. Iterative training sample expansion to increase and balance the accuracy of land classification from VHR imagery10.1109/TGRS.2020.2996064 ↗
5. Landslide Inventory Mapping Method Based on Adaptive Histogram-Mean Distance With Bitemporal VHR Aerial Images
6. Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications10.1016/j.isprsjprs.2017.06.013 ↗
7. Shi, W., Zhang, M., Zhang, R., Chen, S., and Zhan, Z. (2020). Change detection based on artificial intelligence: State-of-the-art and challenges. Remote Sens., 12.10.3390/rs12101688 ↗
8. A critical synthesis of remotely sensed optical image change detection techniques10.1016/j.rse.2015.01.006 ↗
9. PSOSAC: Particle swarm optimization sample consensus algorithm for remote sensing image registration10.1109/LGRS.2017.2783879 ↗
10. Computational intelligence in remote sensing image registration: A survey10.1007/s11633-020-1248-x ↗
11. A neighborhood-based ratio approach for change detection in SAR images10.1109/LGRS.2011.2167211 ↗
12. Lv, Z., Liu, T., Zhang, P., Atli Benediktsson, J., and Chen, Y. (2018). Land cover change detection based on adaptive contextual information using bitemporal remote sensing images. Remote Sens., 10.10.20944/preprints201804.0377.v1 ↗
13. Sequential spectral change vector analysis for iteratively discovering and detecting multiple changes in hyperspectral images10.1109/TGRS.2015.2396686 ↗
14. Robust Change Vector Analysis (RCVA) for multi-sensor very high resolution optical satellite data
15. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
16. Lv, Z., Liu, T., Atli Benediktsson, J., Lei, T., and Wan, Y. (2018). Multi-scale object histogram distance for LCCD using bitemporal very-high-resolution remote sensing images. Remote Sens., 10.10.3390/rs10111809 ↗
17. Novel adaptive histogram trend similarity approach for land cover change detection by using bitemporal very-high-resolution remote sensing images10.1109/TGRS.2019.2927659 ↗
18. Local histogram-based analysis for detecting land cover change using VHR remote sensing images10.1109/LGRS.2020.2998684 ↗
19. Unsupervised change detection in satellite images using principal component analysis and k-means clustering10.1109/LGRS.2009.2025059 ↗
20. Fuzzy clustering algorithms for unsupervised change detection in remote sensing images10.1016/j.ins.2010.10.016 ↗
21. Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering10.1109/TIP.2011.2170702 ↗
22. Wu, Y., Li, J., Yuan, Y., Qin, A., Miao, Q.G., and Gong, M.G. (2021). Commonality autoencoder: Learning common features for change detection from heterogeneous images. IEEE Trans. Neural Netw. Learn. Syst.10.1109/TNNLS.2021.3056238 ↗
23. Object-based change detection10.1080/01431161.2011.648285 ↗
24. Change detection from remotely sensed images: From pixel-based to object-based approaches10.1016/j.isprsjprs.2013.03.006 ↗
25. Chen, Q., Li, L., Xu, Q., Yang, S., Shi, X., and Liu, X. (2017). Multi-feature segmentation for high-resolution polarimetric SAR data based on fractal net evolution approach. Remote Sens., 9.10.3390/rs9060570 ↗
26. SLIC superpixels compared to state-of-the-art superpixel methods10.1109/TPAMI.2012.120 ↗
27. Object-based change detection using correlation image analysis and image segmentation10.1080/01431160601075582 ↗
28. Tan, K., Zhang, Y., Wang, X., and Chen, Y. (2019). Object-based change detection using multiple classifiers and multi-scale uncertainty analysis. Remote Sens., 11.10.3390/rs11030359 ↗
29. Object-oriented key point vector distance for binary land cover change detection using VHR remote sensing images10.1109/TGRS.2020.2977248 ↗
30. An advanced superpixel-based Markov random field model for unsupervised change detection10.1109/LGRS.2019.2948660 ↗
31. Zhu, L., Zhang, J., and Sun, Y. (2021). Remote Sensing Image Change Detection Using Superpixel Cosegmentation. Information, 12.10.3390/info12020094 ↗
32. Pang, S., Hu, X., Zhang, M., Cai, Z., and Liu, F. (2019). Co-segmentation and superpixel-based graph cuts for building change detection from bitemporal digital surface models and aerial images. Remote Sens., 11.10.3390/rs11060729 ↗
33. Remote sensing image classification based on a cross-attention mechanism and graph convolution
34. Multisource remote sensing data classification with graph fusion network10.1109/TGRS.2020.3047130 ↗
35. Wang, R., Wang, L., Dong, P., Jiao, L., and Chen, J.W. (2021, January 11–16). Graph-Level Neural Network for SAR Image Change Detection. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9555003 ↗
36. Unsupervised change detection analysis in satellite image time series using deep learning combined with graph-based approaches10.1109/JSTARS.2020.2982631 ↗
37. Graph convolutional networks for hyperspectral image classification10.1109/TGRS.2020.3015157 ↗
38. Semisupervised change detection using graph convolutional network10.1109/LGRS.2020.2985340 ↗
39. A review of change detection in multitemporal hyperspectral images: Current techniques, applications, and challenges10.1109/MGRS.2019.2898520 ↗
40. Land cover change detection techniques: Very-high-resolution optical images: A review
41. HFA-Net: High Frequency Attention Siamese Network for Building Change Detection in VHR Remote Sensing Images10.1016/j.patcog.2022.108717 ↗
42. Fully convolutional networks for multisource building extraction from an open aerial and satellite imagery data set10.1109/TGRS.2018.2858817 ↗
43. Building change detection for vhr remote sensing images via local-global pyramid network and cross-task transfer learning strategy
44. Chen, H., and Shi, Z. (2020). A spatial-temporal attention-based method and a new dataset for remote sensing image change detection. Remote Sens., 12.10.3390/rs12101662 ↗
45. Change detection in synthetic aperture radar images based on deep neural networks10.1109/TNNLS.2015.2435783 ↗
46. Automatic change detection in synthetic aperture radar images based on PCANet10.1109/LGRS.2016.2611001 ↗
47. Sea ice change detection in SAR images based on convolutional-wavelet neural networks10.1109/LGRS.2019.2895656 ↗
48. A semisupervised GAN-based multiple change detection framework in multi-spectral images10.1109/LGRS.2019.2941318 ↗
49. Superpixel-based difference representation learning for change detection in multispectral remote sensing images10.1109/TGRS.2017.2650198 ↗
50. Zhang, H., Lin, M., Yang, G., and Zhang, L. (2021). ESCNet: An End-to-End Superpixel-Enhanced Change Detection Network for Very-High-Resolution Remote Sensing Images. IEEE Trans. Neural Netw. Learn. Syst., 1–15.
51. A Spectral and Spatial Attention Network for Change Detection in Hyperspectral Images
52. Unsupervised deep change vector analysis for multiple-change detection in VHR images10.1109/TGRS.2018.2886643 ↗
53. Unsupervised deep slow feature analysis for change detection in multi-temporal remote sensing images10.1109/TGRS.2019.2930682 ↗
54. Graph-based registration, change detection, and classification in very high resolution multitemporal remote sensing data10.1109/JSTARS.2016.2557081 ↗
55. Graph-based change detection for condition monitoring of rotating machines: Techniques for graph similarity10.1109/TR.2018.2866152 ↗
56. Change detection between SAR images using a pointwise approach and graph theory10.1109/TGRS.2015.2493730 ↗
57. Iterative Robust Graph for Unsupervised Change Detection of Heterogeneous Remote Sensing Images10.1109/TIP.2021.3093766 ↗
58. Fan, X., Gong, M., Wu, Y., Qin, A., and Xie, Y. (2021). Propagation Enhanced Neural Message Passing for Graph Representation Learning. IEEE Trans. Knowl. Data Eng.10.1109/TKDE.2021.3102964 ↗
59. Gong, M., Zhou, H., Qin, A., Liu, W., and Zhao, Z. (2022). Self-Paced Co-Training of Graph Neural Networks for Semi-Supervised Node Classification. IEEE Trans. Neural Netw. Learn. Syst.10.1109/TNNLS.2022.3157688 ↗
60. Structured self-attention architecture for graph-level representation learning10.1016/j.patcog.2019.107084 ↗
61. Siamese graph convolutional network for content based remote sensing image retrieval10.1016/j.cviu.2019.04.004 ↗
62. Ouyang, S., and Li, Y. (2020). Combining deep semantic segmentation network and graph convolutional neural network for semantic segmentation of remote sensing imagery. Remote Sens., 13.10.3390/rs13010119 ↗
63. Spectral–spatial graph convolutional networks for semisupervised hyperspectral image classification10.1109/LGRS.2018.2869563 ↗
64. A multiscale graph convolutional network for change detection in homogeneous and heterogeneous remote sensing images
65. An Unsupervised Remote Sensing Change Detection Method Based on Multiscale Graph Convolutional Network and Metric Learning
66. Novel Automatic Approach for Land Cover Change Detection by Using VHR Remote Sensing Images