Impact of Texture Information on Crop Classification with Machine Learning and UAV Images
Source abstract
Abstract
Unmanned aerial vehicle (UAV) images that can provide thematic information at much higher spatial and temporal resolutions than satellite images have great potential in crop classification. Due to the ultra-high spatial resolution of UAV images, spatial contextual information such as texture is often used for crop classification. From a data availability viewpoint, it is not always possible to acquire time-series UAV images due to limited accessibility to the study area. Thus, it is necessary to improve classification performance for situations when a single or minimum number of UAV images are available for crop classification. In this study, we investigate the potential of gray-level co-occurrence matrix (GLCM)-based texture information for crop classification with time-series UAV images and machine learning classifiers including random forest and support vector machine. In particular, the impact of combining texture and spectral information on the classification performance is evaluated for cases that use only one UAV image or multi-temporal images as input. A case study of crop classification in Anbandegi of Korea was conducted for the above comparisons. The best classification accuracy was achieved when multi-temporal UAV images which can fully account for the growth cycles of crops were combined with GLCM-based texture features. However, the impact of the utilization of texture information was not significant. In contrast, when one August UAV image was used for crop classification, the utilization of texture information significantly affected the classification performance. Classification using texture features extracted from GLCM with larger kernel size significantly improved classification accuracy, an improvement of 7.72%p in overall accuracy for the support vector machine classifier, compared with classification based solely on spectral information. These results indicate the usefulness of texture information for classification of ultra-high-spatial-resolution UAV images, particularly when acquisition of time-series UAV images is difficult and only one UAV image is used for crop classification.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote Sensing in Agriculture · Remote-Sensing Image Classification · Remote Sensing and Land Use
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Geoinformatic Engineering, Inha University, Incheon 22212, Korea
Funding
Inha University
References (58)
Show source-provided references
1. Assessing agricultural risks of climate change in the 21st century in a global gridded crop model intercomparison10.1073/pnas.1222463110 ↗
2. Efficient corn and soybean mapping with temporal extendability: A multiyear experiment using Landsat imagery10.1016/j.rse.2013.08.023 ↗
3. Development of biomass evaluation model of winter crop using RGB imagery based on unmanned aerial vehicle
4. Global food demand and the sustainable intensification of agriculture10.1073/pnas.1116437108 ↗
5. Development of a biophysical rice yield model using all-weather climate data
6. Kim, Y., Park, N.-W., and Lee, K.-D. (2018). Self-learning based land-cover classification using sequential class patterns from past land-cover maps. Remote Sens., 9.10.3390/rs9090921 ↗
7. Comparison of simulated hyperspectral HyspIRI and multispectral Landsat 8 and Sentinel-2 imagery for multi-seasonal, regional land-cover mapping10.1016/j.rse.2017.08.028 ↗
8. Mapping crop cover using multi-temporal Landsat 8 OLI imagery10.1080/01431161.2017.1323286 ↗
9. Global land cover mapping from MODIS: Algorithms and early results10.1016/S0034-4257(02)00078-0 ↗
10. Yang, C., Wu, G., Ding, K., Shi, T., Li, Q., and Wang, J. (2017). Improving land use/land cover classification by integrating pixel unmixing and decision tree methods. Remote Sens., 9.10.3390/rs9121222 ↗
11. Hall, O., Dahlin, S., Marstorp, H., Archila Bustos, M., Öborn, I., and Jirström, M. (2018). Classification of maize in complex smallholder farming systems using UAV imagery. Drones, 2.10.3390/drones2030022 ↗
12. Böhler, J., Schaepman, M., and Kneubühler, M. (2018). Crop classification in a heterogeneous arable landscape using uncalibrated UAV data. Remote Sens., 10.10.3390/rs10081282 ↗
13. Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs)10.14358/PERS.81.4.281 ↗
14. Recent applications of unmanned aerial imagery in natural resource management10.1080/15481603.2014.926650 ↗
15. An agricultural perspective on flying sensors10.1109/MGRS.2018.2865815 ↗
16. Poblete-Echeverría, C., Olmedo, G.F., Ingram, B., and Bardeen, M. (2017). Detection and segmentation of vine canopy in ultra-high spatial resolution RGB imagery obtained from unmanned aerial vehicle (UAV): A case study in a commercial vineyard. Remote Sens., 9.10.3390/rs9030268 ↗
17. Ultra-high spatial resolution fractional vegetation cover from unmanned aerial multispectral imagery
18. Object-based change detection using correlation image analysis and image segmentation10.1080/01431160601075582 ↗
19. A review of remote sensing image classification techniques: The role of spatio-contextual information10.5721/EuJRS20144723 ↗
20. Textural features for image classification10.1109/TSMC.1973.4309314 ↗
21. UAV remote sensing for urban vegetation mapping using random forest and texture analysis10.3390/rs70101074 ↗
22. Yang, M.-D., Huang, K.-S., Kuo, Y.-H., Tsai, H.P., and Lin, L.-M. (2017). Spatial and spectral hybrid image classification for rice lodging assessment through UAV imagery. Remote Sen., 9.10.3390/rs9060583 ↗
23. Zhang, X., Cui, J., Wang, W., and Lin, C. (2017). A study for texture feature extraction of high-resolution satellite images based on a direction measure and gray level co-occurrence matrix fusion algorithm. Sensors, 17.10.3390/s17071474 ↗
24. Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information10.1016/j.isprsjprs.2003.10.002 ↗
25. Object-oriented image analysis for mapping shrub encroachment from 1937 to 2003 in southern New Mexico10.1016/j.rse.2004.07.011 ↗
26. An efficient approach based on UAV orthographic imagery to map paddy with support of field-level canopy height from point cloud data10.1109/JSTARS.2018.2829218 ↗
27. de Castro, A.I., Torres-Sánchez, J., Peña, J.M., Jiménez-Brenes, F.M., Csillik, O., and López-Granados, F. (2018). An automatic random forest-OBIA algorithm for early weed mapping between and within crop rows using UAV imagery. Remote Sens., 10.10.3390/rs10020285 ↗
28. Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle10.1080/01431161.2017.1294781 ↗
29. Pixel-based crop classification in Peru from Landsat 7 ETM+ images using a random forest model10.2480/agrmet.D-15-00010 ↗
30. Moeckel, T., Dayananda, S., Nidamanuri, R.R., Nautiyal, S., Hanumaiah, N., Buerkert, A., and Wachendorf, M. (2018). Estimation of vegetable crop parameter by multi-temporal UAV-borne images. Remote Sens., 10.10.3390/rs10050805 ↗
31. Song, Q., Xiang, M., Hovis, C., Zhou, Q., Lu, M., Tang, H., and Wu, W. (2018). Object-based feature selection for crop classification using multi-temporal high-resolution imagery. Int. J. Remote Sens., 1–16.
32. Ma, L., Fu, T., Blaschke, T., Li, M., Tiede, D., Zhou, Z., Ma, X., and Chen, D. (2017). Evaluation of feature selection methods for object-based land cover mapping of unmanned aerial vehicle imagery using random forest and support vector machine classifiers. ISPRS Int. J. Geo-Inf., 6.10.3390/ijgi6020051 ↗
33. Hyperspectral image classification via multitask joint sparse representation and stepwise MRF optimization10.1109/TCYB.2015.2484324 ↗
34. Xie, F., Li, F., Lei, C., and Ke, L. (2018). Representative band selection for hyperspectral image classification. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7090338 ↗
35. Characteristics of UAV aerial images for monitoring of highland Kimchi cabbage10.7745/KJSSF.2017.50.3.162 ↗
36. (2018, October 15). EGIS (Environmental Geographic Information Service). Available online: https://egis.me.go.kr.
37. Random forests10.1023/A:1010933404324 ↗
38. Camps-Valls, G., and Bruzzone, L. (2009). An introduction to kernel learning algorithms. Kernel Methods for Remote Sensing Data Analysis, Wiley.10.1002/9780470748992 ↗
39. A relative evaluation of multiclass image classification by support vector machines10.1109/TGRS.2004.827257 ↗
40. Support vector machines for classification and regression10.1039/B918972F ↗
41. Toward intelligent training of supervised image classifications: Directing training data acquisition for SVM classification10.1016/j.rse.2004.06.017 ↗
42. Meyer, D., Dimitriadou, E., Hornik, K., Weingessel, A., and Leisch, F. (2018, December 28). e1071: Misc Functions of the Department of Statistics, Probability Theory Group (Formerly: E1071), TU Wien. Available online: https://CRAN.R-project.org/package=e1071.
43. Chen, C.H., Pau, L.F., and Wang, P.S.P. (1999). Texture analysis. Handbook of Pattern Recognition & Computer Vision, World Scientific Publishing. [2nd ed.].10.1142/9789812384737 ↗
44. Estimation of tropical forest structure from SPOT-5 satellite images10.1080/01431160903095460 ↗
45. Application of high spatial resolution satellite imagery for riparian and forest ecosystem classification10.1016/j.rse.2007.02.014 ↗
46. Analyzing fine-scale wetland composition using high resolution imagery and texture features
47. R Core Team (2018, December 28). R: A Language and Environment for Statistical Computing. Available online: https://www.R-project.org.
48. Classification and regression by randomForest
49. Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy10.14358/PERS.70.5.627 ↗
50. Application method of unmanned aerial vehicle for crop monitoring in Korea
51. Lillesand, T.M., Kiefer, R.W., and Chipman, J.W. (2008). Remote Sensing and Image Interpretation, Wiley. [6th ed.].
52. Phenological metrics derived over the European continent from NDVI3g data and MODIS time series10.3390/rs6010257 ↗
53. Estimating of transplanting period of highland Kimchi cabbage using UAV imagery
54. Ji, S., Zhang, C., Xu, A., Shi, Y., and Duan, Y. (2018). 3D convolutional neural networks for crop classification with multi-temporal remote sensing images. Remote Sens., 10.10.3390/rs10010075 ↗
55. Urban land cover classification with missing data modalities using deep convolutional neural networks10.1109/JSTARS.2018.2834961 ↗
56. A novel active learning approach for the classification of hyperspectral imagery using quasi-Newton multinomial logistic regression10.1080/01431161.2018.1433893 ↗
57. Performance evaluation of machine learning and deep learning algorithms in crop classification: Impact of hyper-parameters and training sample size
58. Yu, L., Su, J., Li, C., Wang, L., Luo, Z., and Yan, B. (2018). Improvement of moderate resolution land use and land cover classification by introducing adjacent region features. Remote Sens., 10.10.3390/rs10030414 ↗