journal article·2024Open access

A Systematic Literature Review of Machine Learning and Deep Learning Approaches for Spectral Image Classification in Agricultural Applications Using Aerial Photography

Usman Khan, Muhammad Khalid Khan, Muhammad Ayub Latif, Muhammad Naveed, Muhammad Mansoor Alam, Salman A. Khan, Mazliham Mohd Su’ud

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

Recently, there has been a notable surge of interest in scientific research regarding spectral images. The potential of these images to revolutionize the digital photography industry, like aerial photography through Unmanned Aerial Vehicles (UAVs), has captured considerable attention. One encouraging aspect is their combination with machine learning and deep learning algorithms, which have demonstrated remarkable outcomes in image classification. As a result of this powerful amalgamation, the adoption of spectral images has experienced exponential growth across various domains, with agriculture being one of the prominent beneficiaries. This paper presents an extensive survey encompassing multispectral and hyperspectral images, focusing on their applications for classification challenges in diverse agricultural areas, including plants, grains, fruits, and vegetables. By meticulously examining primary studies, we delve into the specific agricultural domains where multispectral and hyperspectral images have found practical use. Additionally, our attention is directed towards utilizing machine learning techniques for effectively classifying hyperspectral images within the agricultural context. The findings of our investigation reveal that deep learning and support vector machines have emerged as widely employed methods for hyperspectral image classification in agriculture. Nevertheless, we also shed light on the various issues and limitations of working with spectral images. This comprehensive analysis aims to provide valuable insights into the current state of spectral imaging in agriculture and its potential for future advancements.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Spectroscopy and Chemometric Analyses · Smart Agriculture and AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (100+)

Show source-provided references
1. Applications of image processing in agriculture: A survey
2. Investigating the potential of using the spatial and spectral information of multispectral LiDAR for object classification10.3390/s150921989 ↗
3. A comparative assessment of different modeling algorithms for estimating leaf nitrogen content in winter wheat using multispectral images from an unmanned aerial vehicle10.3390/rs10122026 ↗
4. Computer vision technology in agricultural automation—A review
5. Hyperspectral imaging: A review on UAV-based sensors, data processing and applications for agriculture and forestry10.3390/rs9111110 ↗
6. Quantitative estimation of soil salinity using UAV-borne hyperspectral and satellite multispectral images10.3390/rs11070736 ↗
7. An overview of autonomous vehicles sensors and their vulnerability to weather conditions10.3390/s21165397 ↗
8. Examining the transmission of visible light through electrospun nanofibrous PCL scaffolds for corneal tissue engineering10.3390/nano11123191 ↗
9. Applications of fluorescence spectroscopy, RGB- and multispectral imaging for quality determinations of white meat: A review10.3390/bios12020076 ↗
10. Pedestrian detection using multispectral images and a deep neural network10.3390/s21072536 ↗
11. A machine learning approach to detecting pine wilt disease using airborne spectral imagery10.3390/rs12142280 ↗
12. Detection of counterfeit banknotes using multispectral images10.1016/j.dsp.2018.03.015 ↗
13. Automatic counterfeit currency detection using a novel snapshot hyperspectral imaging algorithm10.3390/s23042026 ↗
14. Fake banknote detection using multispectral images
15. Applications of multispectral and hyperspectral imaging in dermatology
16. Development of a multi-spectral imaging system for the detection of bruises on apples
17. Apple powdery mildew infestation detection and mapping using high-resolution visible and multispectral aerial imaging technique10.1016/j.scienta.2021.110228 ↗
18. Quality evaluation of mono & bi-colored apples with computer vision and multispectral imaging10.1007/s11042-019-08564-3 ↗
19. Apple fruit recognition algorithm based on multi-spectral dynamic image analysis10.3390/s19040949 ↗
20. A survey of classical methods and new trends in pansharpening of multispectral images
21. Systematic review of anomaly detection in hyperspectral remote sensing applications10.3390/app11114878 ↗
22. Hyperspectral and multispectral image processing for gross-level tumor detection in skin lesions: A systematic review10.1117/1.JBO.27.6.060901 ↗
23. Hyperspectral and multispectral imaging in digital and computational pathology: A systematic review [Invited]10.1364/BOE.386338 ↗
24. Support vector machine versus convolutional neural network for hyperspectral image classification: A systematic review10.1002/cpe.6945 ↗
25. Hyperspectral image classification: Potentials, challenges, and future directions
26. Deep learning applications for hyperspectral imaging: A systematic review10.33969/JIEC.2020.21004 ↗
27. A survey of image classification methods and techniques for improving classification performance10.1080/01431160600746456 ↗
28. Using linear regression, random forests, and support vector machine with unmanned aerial vehicle multispectral images to predict canopy nitrogen weight in corn10.3390/rs12132071 ↗
29. A deep learning approach for weed detection in lettuce crops using multispectral images
30. Detection of oil pollution impacts on vegetation using multi-frequency SAR, multispectral images with fuzzy forest and random forest methods10.1016/j.envpol.2019.113360 ↗
31. Monitoring plant status and fertilization strategy through multispectral images10.3390/s20020435 ↗
32. Monitoring of sugar beet growth indicators using wide-dynamic-range vegetation index (WDRVI) derived from UAV multispectral images10.1016/j.compag.2020.105331 ↗
33. Contribution of multispectral (optical and radar) satellite images to the classification of agricultural surfaces
34. Estimation of peanut leaf area index from unmanned aerial vehicle multispectral images10.3390/s20236732 ↗
35. Detection and classification of potato defects using multispectral imaging system based on single shot method10.1007/s12161-019-01654-w ↗
36. Perspective of inline control of latent defects and diseases on French fries with multispectral imaging10.1117/12.515371 ↗
37. Multispectral image based germination detection of potato by using supervised multiple threshold segmentation model and Canny edge detector10.1016/j.compag.2021.106041 ↗
38. An overview of current and potential applications of thermal remote sensing in precision agriculture10.1016/j.compag.2017.05.001 ↗
39. Hyperspectral image classification: A k-means clustering based approach
40. Estimating the maize biomass by crop height and narrowband vegetation indices derived from UAV-based hyperspectral images10.1016/j.ecolind.2021.107985 ↗
41. Predicting leaf nitrogen content in olive trees using hyperspectral data for precision agriculture10.1007/s11119-020-09727-1 ↗
42. The role of remote sensing in olive growing farm management: A research outlook from 2000 to the present in the framework of precision agriculture applications10.3390/rs14235951 ↗
43. Unmanned aerial vehicle for remote sensing applications—A review10.3390/rs11121443 ↗
44. A review of current and potential applications of remote sensing to study the water status of horticultural crops10.3390/agronomy10010140 ↗
45. Airborne hyperspectral imagery and yield monitor data for mapping cotton yield variability10.1007/s11119-004-5319-8 ↗
46. Retrieval of water quality parameters from hyperspectral images using a hybrid feedback deep factorization machine model10.1016/j.watres.2021.117618 ↗
47. Spectral requirements on airborne hyperspectral remote sensing data for wheat disease detection10.1007/s11119-011-9222-9 ↗
48. Hyperspectral imaging-based classification and wavebands selection for internal defect detection of pickling cucumbers10.1007/s11947-013-1177-6 ↗
49. Machine learning and concept formation10.1007/BF00114263 ↗
50. Artificial intelligence and computational pathology10.1038/s41374-020-00514-0 ↗
51. Systematic literature reviews in software engineering—A tertiary study10.1016/j.infsof.2010.03.006 ↗
52. Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress10.1186/s13007-017-0233-z ↗
53. An active thermography method for immature citrus fruit detection10.1016/j.biosystemseng.2020.08.015 ↗
54. Park · Comput. Electron. Agric. · 2018 · 148 · 17910.1016/j.compag.2018.02.025 ↗
55. Apple flower detection using deep convolutional networks10.1016/j.compind.2018.03.010 ↗
56. Maturity estimation of mangoes using hyperspectral imaging from a ground based mobile platform10.1016/j.compag.2018.10.021 ↗
57. Rapid discrimination of high-quality watermelon seeds by multispectral imaging combined with chemometric methods10.1007/s10812-019-00757-w ↗
58. Plants disease identification and classification through leaf images: A survey10.1007/s11831-018-9255-6 ↗
59. A performance assessment of rose plant classification using machine learning
60. Detection of early decayed oranges based on multispectral principal component image combining both bi-dimensional empirical mode decomposition and watershed segmentation method10.1016/j.postharvbio.2019.110986 ↗
61. Detection of nutrition deficiencies in plants using proximal images and machine learning: A review10.1016/j.compag.2019.04.035 ↗
62. Multi-modal deep learning for Fuji apple detection using RGB-D cameras and their radiometric capabilities10.1016/j.compag.2019.05.016 ↗
63. Hyperspectral fruit and vegetable classification using convolutional neural networks10.1016/j.compag.2019.04.019 ↗
64. Fruit detection in an apple orchard using a mobile terrestrial laser scanner10.1016/j.biosystemseng.2019.08.017 ↗
65. A computer vision system for defect discrimination and grading in tomatoes using machine learning and image processing
66. UAV-based multispectral imagery for fast citrus greening detection10.1007/s41348-019-00234-8 ↗
67. Applications of computer vision in plant pathology: A survey10.1007/s11831-019-09324-0 ↗
68. Vine disease detection in UAV multispectral images using optimized image registration and deep learning segmentation approach10.1016/j.compag.2020.105446 ↗
69. Comparison of machine learning methods for citrus greening detection on UAV multispectral images10.1016/j.compag.2020.105234 ↗
70. Application of spectroscopic and multispectral imaging technologies on the assessment of ready-to-eat pineapple quality: A performance evaluation study of machine learning models generated from two commercial data analytics tools10.1016/j.compag.2020.105529 ↗
71. Visual detection of green mangoes by an unmanned aerial vehicle in orchards based on a deep learning method10.1016/j.biosystemseng.2020.04.006 ↗
72. A near real-time deep learning approach for detecting rice phenology based on UAV images10.1016/j.agrformet.2020.107938 ↗
73. A deep neural network approach towards real-time on-branch fruit recognition for precision horticulture10.1016/j.eswa.2020.113594 ↗
74. On line detection of defective apples using computer vision system combined with deep learning methods10.1016/j.jfoodeng.2020.110102 ↗
75. Automatic blossom detection in apple trees using deep learning
76. Computer vision based detection of external defects on tomatoes using deep learning10.1016/j.biosystemseng.2019.12.003 ↗
77. Real-time hyperspectral imaging for the in-field estimation of strawberry ripeness with deep learning
78. Extracting apple tree crown information from remote imagery using deep learning10.1016/j.compag.2020.105504 ↗
79. Recent advances in imaging techniques for bruise detection in fruits and vegetables10.1016/j.tifs.2020.02.024 ↗
80. Non-destructive identification of single hard seed via multispectral imaging analysis in six legume species10.1186/s13007-020-00659-5 ↗
81. Accuracy of carrot yield forecasting using proximal hyperspectral and satellite multispectral data10.1007/s11119-020-09722-6 ↗
82. Apple fruit sorting using novel thresholding and area calculation algorithms10.1007/s00500-020-05158-2 ↗
83. IoT-based agriculture: Deep learning in detecting apple fruit diseases10.1016/j.micpro.2021.104321 ↗
84. Using unmanned aerial systems and deep learning for agriculture mapping in Dubai10.1016/j.heliyon.2021.e08154 ↗
85. Strawberry maturity classification from UAV and near-ground imaging using deep learning10.1016/j.atech.2021.100001 ↗
86. Assessment for crop water stress with infrared thermal imagery in precision agriculture: A review and future prospects for deep learning applications10.1016/j.compag.2021.106019 ↗
87. Automatic late blight lesion recognition and severity quantification based on field imagery of diverse potato genotypes by deep learning10.1016/j.knosys.2020.106723 ↗
88. A deep learning-integrated micro-CT image analysis pipeline for quantifying rice lodging resistance-related traits10.1016/j.xplc.2021.100165 ↗
89. Plant leaf disease classification using deep convolutional neural network with Bayesian learning
90. UAV-based coffee yield prediction utilizing feature selection and deep learning10.1016/j.atech.2021.100010 ↗
91. Quality control of apples by means of convolutional neural networks—Comparison of bruise detection by color images and near-infrared images10.1016/j.procir.2021.03.043 ↗
92. Prediction of plant-level tomato biomass and yield using machine learning with unmanned aerial vehicle imagery10.1186/s13007-021-00761-2 ↗
93. Detection of early bruises on pears using fluorescence hyperspectral imaging technique10.1007/s12161-021-02092-3 ↗
94. A rapid, low-cost deep learning system to classify strawberry disease based on cloud service10.1016/S2095-3119(21)63604-3 ↗
95. Coffee ripeness monitoring using a UAV-mounted low-cost multispectral camera10.1007/s11119-021-09838-3 ↗
96. UAV-based multispectral imagery for fast citrus greening detection10.1007/s41348-019-00234-8 ↗
97. Hyperspectral image classification using convolutional neural networks and multiple feature learning10.3390/rs10020299 ↗
98. Ensemble extreme learning machines for hyperspectral image classification10.1109/JSTARS.2014.2301775 ↗
99. Local manifold sparse model for image classification10.1016/j.neucom.2019.11.084 ↗
100. Spectral-spatial feature extraction of hyperspectral images based on propagation filter10.3390/s18061978 ↗