journal article·2023-02-15Open access

Bilateral Attention U-Net with Dissimilarity Attention Gate for Change Detection on Remote Sensing Imageries

Jongseok Lee, Wahyu Wiratama, Wooju Lee, Ismail Marzuki, Donggyu Sim

Applied Sciences· Volume 13· Issue 4

Abstract

This study proposes a bilateral attention U-Net with a dissimilarity attention gate (DAG) for change detection on remote sensing imageries. The proposed network is designed with a bilateral dissimilarity encoding for the DAG calculation to handle reversible input images, resulting in high detection rates regardless of the order of the two input images for change detection. The DAG exploits all the combinations of joint features to avoid spectral information loss fed into an attention gate on the decoder side. The effectiveness of the proposed method was evaluated on the KOMPSAT-3 satellite images dataset and the aerial change detection dataset (CDD). Its performance was better than that of conventional methods (specifically, U-Net, ATTUNet, and Modified-UNet++) as it achieved average F1-score and kappa coefficient (KC) values of 0.68 and 66.93, respectively, for the KOMPSAT-3 dataset. For CDD, it achieved F1-score and KC values of 0.70 and 68.74, respectively, which are also better values than those achieved by conventional methods. In addition, we found that the proposed bilateral attention U-Net can provide the same changed map regardless of whether the image order is reversed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Geochemistry and Geologic Mapping · Remote Sensing and Land Use

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Kwangwoon University, Seoul 139701, Republic of Korea

Funding

Ministry of Science and Technology Infor-mation and Communication · Kwangwoon University in 2021 and the MSIT (Ministry of Science and ICT), Korea · IITP(Institute of Information & Communications Technology Planning & Evaluation

References (33)

Show source-provided references
1. Singh, K.K., Mehrotra, A., Nigam, M.J., and Pal, K. (2013, January 12–14). Unsupervised change detection from remote sensing images using hybrid genetic FCM. Proceedings of the 2013 Students Conference on Engineering and Systems (SCES), Allahabad, India.10.1109/SCES.2013.6547529 ↗
2. Bi, C., Wang, H., and Bao, R. (2014, January 27–29). SAR image change detection using regularized dictionary learning and fuzzy clustering. Proceedings of the 2014 IEEE 3rd International Conference on Cloud Computing and Intelligence Systems, Shenzhen, China.
3. Change detection in synthetic aperture radar images based on image fusion and fuzzy clustering10.1109/TIP.2011.2170702 ↗
4. Fuzzy clustering with a modified MRF energy function for change detection in synthetic aperture radar images10.1109/TFUZZ.2013.2249072 ↗
5. Unsupervised change detection using fuzzy c-means and MRF from remotely sensed images10.1080/2150704X.2013.858841 ↗
6. Unsupervised change detection using a novel fuzzy c-means clustering simultaneously incorporating local and global information10.1007/s11042-017-4354-1 ↗
7. Fei, G., Lu, Z., Jun, W., and Jingyuan, M. (2015, January 9–10). Change detection in remote sensing images of damage areas with complex terrain using texture information and SVM. Proceedings of the 2015 AASRI International Conference on Circuits and Systems (CAS 2015), Paris, France.10.2991/cas-15.2015.54 ↗
8. Support vector reduction in SVM algorithm for abrupt change detection in remote sensing10.1109/LGRS.2009.2020306 ↗
9. Supervised change detection in VHR images using contextual information and support vector machines
10. A novel approach to unsupervised change detection based on a semisupervised SVM and a similarity measure10.1109/TGRS.2008.916643 ↗
11. Deep learning and super pixel feature extraction based on contractive autoencoder for change detection in SAR images10.1109/TII.2018.2873492 ↗
12. Temporal change detection in SAR images using log cumulants and stacked autoencoder10.1109/LGRS.2017.2786344 ↗
13. Wiratama, W., Lee, J., Park, S.-E., and Sim, D. (2018). Dual-dense convolution network for change detection of high-resolution panchromatic imagery. Appl. Sci., 8.10.3390/app8101785 ↗
14. Wiratama, W., and Sim, D. (2019). Fusion network for change detection of high-resolution panchromatic imagery. Appl. Sci., 9.10.3390/app9071441 ↗
15. Zhang, W., and Lu, X. (2019). The spectral-spatial joint learning for change detection in multispectral imagery. Remote Sens., 11.10.3390/rs11030240 ↗
16. Zhang, Z., Vosselman, G., Gerke, M., Tuia, D., and Yang, M.Y. (2018). Change detection between multimodal remote sensing data using Siamese CNN. arXiv, Available online: https://arxiv.org/abs/1807.09562.
17. Hong, D., Qiu, C., Yu, A., Quan, Y., Liu, B., and Chen, X. (2023). Multi-Task Learning for Building Extraction and Change Detection from Remote Sensing Images. Appl. Sci., 13.10.3390/app13021037 ↗
18. Change Detection Based on Supervised Contrastive Learning for High-Resolution Remote Sensing Imagery10.1109/TGRS.2023.3236664 ↗
19. Building change detection using the parallel spatial-channel attention block and edge-guided deep network
20. Zhao, B., Luo, X., Tang, P., Liu, Y., Wan, H., and Ouyang, N. (2022). STDecoder-CD: How to Decode the Hierarchical Transformer in Change Detection Tasks. Appl. Sci., 12.10.3390/app12157903 ↗
21. Change detection on multi-spectral images based on feature-level U-Net10.1109/ACCESS.2020.2964798 ↗
22. Peng, D., Zhang, Y., and Guan, H. (2019). End-to-end change detection for high resolution satellite images using improved unet++. Remote Sens., 11.10.3390/rs11111382 ↗
23. Navab, N., Hornegger, J., Wells, W.M., and Frangi, A.F. (2015). Medical Image Computing and Computer-Assisted Intervention 2015, Springer International Publishing.10.1007/978-3-319-24553-9 ↗
24. Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainza, B. (2018, January 4–6). Attention u-net: Learning where to look for the pancreas. Proceedings of the International Conference of Medical Imaging with Deep Learning, Amsterdam, Netherlands.
25. Feature extraction for hyperspectral imagery: The evolution from shallow to deep: Overview and toolbox)10.1109/MGRS.2020.2979764 ↗
26. Noh, H., Hong, S., and Han, B. (2015, January 7–13). Learning deconvolution network for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.178 ↗
27. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
28. (2023, January 20). KOMPSAT-3 Product Specifications Version 2.0. Available online: http://www.si-imaging.com/resources/?pageid=2&uid=232&mod=document.
29. Change detection in remote sensing images using conditional adversarial networks10.5194/isprs-archives-XLII-2-565-2018 ↗
30. Altman, D.G. (1991). Practical Statistics for Medical Research, Chapman & Hall/CRC.
31. Gwet, K. (2014). Hnadbook of Inter-Rater Reliability, Advanced Analytics Press.10.1002/9781118445112.stat06882 ↗
32. An unsupervised domain adaptation approach for change detection and its application to deforestation mapping in tropical biomes10.1016/j.isprsjprs.2021.08.026 ↗
33. PIIE-DSA-Net for 3D semantic segmentation of urban indoor and outdoor datasets