journal article·2024Open access

Enhancing Hyper-Spectral Image Classification with Reinforcement Learning and Advanced Multi-Objective Binary Grey Wolf Optimization

Mehrdad Shoeibi, Mohammad Mehdi Sharifi Nevisi, Reza Salehi, Diego Martín, Zahra Halimi, Sahba Baniasadi

Computers, Materials & Continua· Volume 79· Issue 3

Abstract

Hyperspectral (HS) image classification plays a crucial role in numerous areas including remote sensing (RS), agriculture, and the monitoring of the environment. Optimal band selection in HS images is crucial for improving the efficiency and accuracy of image classification. This process involves selecting the most informative spectral bands, which leads to a reduction in data volume. Focusing on these key bands also enhances the accuracy of classification algorithms, as redundant or irrelevant bands, which can introduce noise and lower model performance, are excluded. In this paper, we propose an approach for HS image classification using deep Q learning (DQL) and a novel multi-objective binary grey wolf optimizer (MOBGWO). We investigate the MOBGWO for optimal band selection to further enhance the accuracy of HS image classification. In the suggested MOBGWO, a new sigmoid function is introduced as a transfer function to modify the wolves’ position. The primary objective of this classification is to reduce the number of bands while maximizing classification accuracy. To evaluate the effectiveness of our approach, we conducted experiments on publicly available HS image datasets, including Pavia University, Washington Mall, and Indian Pines datasets. We compared the performance of our proposed method with several state-of-the-art deep learning (DL) and machine learning (ML) algorithms, including long short-term memory (LSTM), deep neural network (DNN), recurrent neural network (RNN), support vector machine (SVM), and random forest (RF). Our experimental results demonstrate that the Hybrid MOBGWO-DQL significantly improves classification accuracy compared to traditional optimization and DL techniques. MOBGWO-DQL shows greater accuracy in classifying most categories in both datasets used. For the Indian Pine dataset, the MOBGWO-DQL architecture achieved a kappa coefficient (KC) of 97.68% and an overall accuracy (OA) of 94.32%. This was accompanied by the lowest root mean square error (RMSE) of 0.94, indicating very precise predictions with minimal error. In the case of the Pavia University dataset, the MOBGWO-DQL model demonstrated outstanding performance with the highest KC of 98.72% and an impressive OA of 96.01%. It also recorded the lowest RMSE at 0.63, reinforcing its accuracy in predictions. The results clearly demonstrate that the proposed MOBGWO-DQL architecture not only reaches a highly accurate model more quickly but also maintains superior performance throughout the training process.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Face and Expression Recognition · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (50)

Show source-provided references
1. Hyperspectral image classification via active learning and broad learning system10.1007/s10489-021-02805-5 ↗
2. Open set classification of Hyperspectral images with energy models10.1080/01431161.2023.2288950 ↗
3. Research on intelligent clearing of weeds in wheat fields using spectral imaging and machine learning10.1016/j.jclepro.2023.139409 ↗
4. Secrecy performance analysis of RIS-aided smart grid communications10.1109/TII.2023.3333842 ↗
5. Performance analysis of RIS/STAR-IOS-aided V2V NOMA/OMA communications over composite fading channels10.1109/TIV.2023.3337898 ↗
6. An efficient authentication protocol for smart grid communication based on on-chip-error-correcting physical unclonable function10.1016/j.segan.2023.101228 ↗
7. Optimal band selection using evolutionary machine learning to improve the accuracy of hyper-spectral images classification: A novel migration-based particle swarm optimization10.1007/s00357-023-09448-w ↗
8. Information leakage in deep learning-based hyperspectral image classification: A survey10.3390/rs15153793 ↗
9. Hyperspectral band selection: A review10.1109/MGRS.2019.2911100 ↗
10. An efficient method for supervised hyperspectral band selection10.1109/LGRS.2010.2053516 ↗
11. Optimal clustering framework for hyperspectral band selection
12. Hyperspectral band selection via adaptive subspace partition strategy10.1109/JSTARS.2019.2941454 ↗
13. Multi-view learning for hyperspectral image classification: An overview10.1016/j.neucom.2022.05.093 ↗
14. Masked auto-encoding spectral-spatial transformer for hyperspectral image classification10.1109/TGRS.2022.3217892 ↗
15. Semi-active convolutional neural networks for hyperspectral image classification10.1109/TGRS.2022.3230411 ↗
16. Hyperspectral image classification with contrastive self-supervised learning under limited labeled samples
17. Hyperspectral image classification with optimized compressed synergic deep convolution neural network with aquila optimization
18. Hyperspectral image classification using meta-heuristics and artificial neural network
19. New framework for hyperspectral band selection using modified wind-driven optimization algorithm10.1080/01431161.2019.1607609 ↗
20. Application of meta-heuristic algorithms for training neural networks and deep learning architectures: A comprehensive review10.1007/s11063-022-11055-6 ↗
22. TDMBBO: A novel three-dimensional migration model of biogeogra-phy-based optimization (case study: Facility planning and benchmark problems)10.1007/s11227-023-05047-z ↗
23. Chimp optimization algorithm10.1016/j.eswa.2020.113338 ↗
24. Double deep Q-network for hyperspectral image band selection in land cover classification applications10.3390/rs15030682 ↗
25. Secrecy performance analysis of backscatter communications with side information10.3390/s23208358 ↗
26. Deep reinforcement learning for semisupervised hyperspectral band selection
27. Deep reinforcement learning enables adaptive-image augmentation for automated optical inspection of plant rust10.3389/fpls.2023.1142957 ↗
28. Deep reinforcement learning for band selection in hyperspectral image classification
29. Active learning-based hyperspectral image classification: A reinforcement learning approach10.1007/s11227-023-05568-7 ↗
30. Hyperspectral feature selection for SOM prediction using deep reinforcement learning and multiple subset evaluation strategies10.3390/rs15010127 ↗
31. Hyperspectral band selection within a deep reinforcement learning framework
32. Deep Q learning-based traffic signal control algorithms: Model development and evaluation with field data10.1080/15472450.2021.2023016 ↗
33. Transaction selection policy in tier-to-tier SBSRS by using deep Q-learning10.1080/00207543.2022.2148767 ↗
34. An efficient modeling attack for breaking the security of XOR-Arbiter PUFs by using the fully connected and long-short term memory10.1016/j.micpro.2022.104667 ↗
35. Hyperspectral image classification via contextual deep learning10.1186/s13640-015-0071-8 ↗
36. Pulse repetition interval modulation recognition using deep CNN evolved by extreme learning machines and IP-based BBO algorithm10.1016/j.engappai.2023.106415 ↗
37. Solving the local positioning problem using a four-layer artificial neural network
38. Hyperspectral band selection based on deep convolutional neural network and distance density10.1109/LGRS.2017.2765339 ↗
39. DeepSpectra: An end-to-end deep learning approach for quantitative spectral analysis10.1016/j.aca.2019.01.002 ↗
40. Deep learning-based classification of hyperspectral data10.1109/JSTARS.2014.2329330 ↗
41. Hyperspectral imagery classification based on semi-supervised 3-D deep neural network and adaptive band selection10.1016/j.eswa.2019.04.006 ↗
42. Region-aware hierarchical latent feature representation learning-guided clustering for hyperspectral band selection10.1109/TCYB.2022.3191121 ↗
43. Spatial and spectral structure preserved self-representation for unsupervised hyperspectral band selection
44. Pasture biomass estimation using ultra-high-resolution RGB UAVs images and deep learning10.3390/rs15245714 ↗
45. Estimation of bale grazing and sacrificed pasture biomass through the integration of sentinel satellite images and machine learning techniques10.3390/rs15205014 ↗
46. Beluga whale optimization: A novel nature-inspired metaheuristic algorithm10.1016/j.knosys.2022.109215 ↗
47. Orchard algorithm (OA): A new meta-heuristic algorithm for solving discrete and continuous optimization problems10.1016/j.matcom.2022.12.027 ↗
48. Binary chimp optimization algorithm (BChOA): A new binary meta-heuristic for solving optimization problems10.1007/s12559-021-09933-7 ↗
49. DDNSAS: Deep reinforcement learning based deep Q-learning network for smart agriculture system
50. A comparative study of reinforcement learning algorithms for distribution network reconfiguration with deep Q-learning-based action sampling10.1109/ACCESS.2023.3243549 ↗