journal article·2020Open access

Deep Feature Extraction and Feature Fusion for Bi-temporal Satellite Image Classification

Anju Asokan, J Anitha, Bogdan Patrut, Dana Danciulescu, D Jude Hemanth

Computers, Materials & Continua· Volume 66· Issue 1

Abstract

Multispectral images contain a large amount of spatial and spectral data which are effective in identifying change areas. Deep feature extraction is important for multispectral image classification and is evolving as an interesting research area in change detection. However, many deep learning framework based approaches do not consider both spatial and textural details into account. In order to handle this issue, a Convolutional Neural Network (CNN) based multi-feature extraction and fusion is introduced which considers both spatial and textural features. This method uses CNN to extract the spatio-spectral features from individual channels and fuse them with the textural features. Then the fused image is classified into change and unchanged regions. The presence of mixed pixels in the bitemporal satellite images affect the classification accuracy due to the misclassification errors. The proposed method was compared with six state-of-theart change detection methods and analyzed. The main highlight of this method is that by taking into account the spatio-spectral and textural information in the input channels, the mixed pixel problem is solved. Experiments indicate the effectiveness of this method and demonstrate that it possesses low misclassification errors, higher overall accuracy and kappa coefficient.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Advanced Image Fusion Techniques · Remote Sensing and Land Use

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (39)

Show source-provided references
1. Mixed pixels: A challenge in remote sensing data classification for improving performance
2. Unsupervised change detection in high spatial resolution remote sensing images based on a conditional random field model10.5721/EuJRS20164913 ↗
3. Strategies combining spectral angle mapper and change vector analysis to unsupervised change detection in multispectral images10.1109/LGRS.2016.2536058 ↗
4. PCA-based land-use change detection and analysis using multitemporal and multisensor satellite data10.1080/01431160801950162 ↗
5. Land change detection using multivariate alteration detection and chi squared test thresholding
6. Sample selection based change detection with dilated network learning in remote sensing images10.1007/s11220-019-0252-0 ↗
7. Unsupervised deep change vector analysis for multiple-change detection in VHR images10.1109/TGRS.2018.2886643 ↗
8. Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network10.1080/2150704X.2017.1280200 ↗
9. Automatic change detection in synthetic aperture radar images based on PCANet10.1109/LGRS.2016.2611001 ↗
10. Deep learning and superpixel feature extraction based on contractive autoencoder for change detection in SAR images10.1109/TII.2018.2873492 ↗
11. Learning a transferable change rule from a recurrent neural network for land cover change detection10.3390/rs8060506 ↗
12. Semi-supervised change detection using modified self-organizing feature map neural network10.1016/j.asoc.2013.09.010 ↗
13. A deep convolutional coupling network for change detection based on heterogeneous optical and radar images10.1109/TNNLS.2016.2636227 ↗
14. Spatial and semantic convolutional features for robust visual object tracking10.1007/s11042-018-6562-8 ↗
15. A novel image classification approach via Dense-MobileNet models, Mobile Information Systems10.1155/2020/8836195 ↗
16. Research of improving semantic image segmentation based on a feature fusion model
17. Electrocardiogram soft computing using hybrid deep learning CNN-ELM10.1016/j.asoc.2019.105778 ↗
18. Land-cover classification of multispectral LiDAR data using CNN with optimized hyper-parameters, ISPRS10.1016/j.isprsjprs.2020.05.022 ↗
19. Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain10.1007/s00521-018-3441-1 ↗
20. Ensemble of CNN for multi-focus image fusion10.1016/j.inffus.2019.02.003 ↗
21. A novel algorithm of remote sensing image fusion based on shift-invariant Shearlet transform and regional selection
22. Anandhi · Computers & Electrical Engineering · 2018 · 65 · 13910.1016/j.compeleceng.2017.04.002 ↗
23. A novel multi-modality image fusion method based on image decomposition and sparse representation10.1016/j.ins.2017.09.010 ↗
24. Infrared and visual image fusion through infrared feature extraction and visual information preservation10.1016/j.infrared.2017.05.007 ↗
25. Multi-focus image fusion using deep support value convolutional neural network10.1016/j.ijleo.2018.09.089 ↗
26. Multispectral and panchromatic image fusion based on spatial consistency10.1080/01431161.2017.1395967 ↗
27. Spatial–spectral fusion by combining deep learning and variational model10.1109/TGRS.2019.2904659 ↗
28. Spectral image fusion from compressive measurements using spectral unmixing and a sparse representation of abundance maps10.1109/TGRS.2019.2895822 ↗
29. Multiscale fast correlation filtering tracking algorithm based on a feature fusion model
30. Deep feature fusion through adaptive discriminative metric learning for scene recognition10.1016/j.inffus.2020.05.005 ↗
31. Multi-focus image fusion with a deep convolutional neural network10.1016/j.inffus.2016.12.001 ↗
32. The edge detection enhancement on satellite image using bilateral filter10.1088/1757-899X/308/1/012052 ↗
33. Bilateral filtering as a tool for image smoothing with edge preserving properties
34. Suitability of bilateral filtering for edge-preserving noise reduction in PET10.1186/2191-219X-1-23 ↗
35. Medical image enhancement by a bilateral filter using optimization technique10.1007/s10916-019-1370-x ↗
36. Real-time specular highlight removal using bilateral filtering
37. Learning spectral-spatialoral features via a recurrent convolutional neural network for change detection in multispectral imagery10.1109/TGRS.2018.2863224 ↗
38. Supervised deep feature extraction for hyperspectral image classification10.1109/TGRS.2017.2769673 ↗
39. Convolutional architecture for fast feature embedding