journal article·2019-04-07Open access

Comparison of Machine Learning Regression Algorithms for Cotton Leaf Area Index Retrieval Using Sentinel-2 Spectral Bands

Huihui Mao, Jihua Meng, Fujiang Ji, Qiankun Zhang, Huiting Fang

Applied Sciences· Volume 9· Issue 7

Abstract

Leaf area index (LAI) is a crucial crop biophysical parameter that has been widely used in a variety of fields. Five state-of-the-art machine learning regression algorithms (MLRAs), namely, artificial neural network (ANN), support vector regression (SVR), Gaussian process regression (GPR), random forest (RF) and gradient boosting regression tree (GBRT), have been used in the retrieval of cotton LAI with Sentinel-2 spectral bands. The performances of the five machine learning models are compared for better applications of MLRAs in remote sensing, since challenging problems remain in the selection of MLRAs for crop LAI retrieval, as well as the decision as to the optimal number for the training sample size and spectral bands to different MLRAs. A comprehensive evaluation was employed with respect to model accuracy, computational efficiency, sensitivity to training sample size and sensitivity to spectral bands. We conducted the comparison of five MLRAs in an agricultural area of Northwest China over three cotton seasons with the corresponding field campaigns for modeling and validation. Results show that the GBRT model outperforms the other models with respect to model accuracy in average ( R 2 ¯ = 0.854, R M S E ¯ = 0.674 and M A E ¯ = 0.456). SVR achieves the best performance in computational efficiency, which means it is fast to train, and to validate that it has great potentials to deliver near-real-time operational products for crop management. As for sensitivity to training sample size, GBRT behaves as the most robust model, and provides the best model accuracy on the average among the variations of training sample size, compared with other models ( R 2 ¯ = 0.884, R M S E ¯ = 0.615 and M A E ¯ = 0.452). Spectral bands sensitivity analysis with dCor (distance correlation), combined with the backward elimination approach, indicates that SVR, GPR and RF provide relatively robust performance to the spectral bands, while ANN outperforms the other models in terms of model accuracy on the average among the reduction of spectral bands ( R 2 ¯ = 0.881, R M S E ¯ = 0.625 and M A E ¯ = 0.480). A comprehensive evaluation indicates that GBRT is an appealing alternative for cotton LAI retrieval, except for its computational efficiency. Despite the different performance of the ML models, all models exhibited considerable potential for cotton LAI retrieval, which could offer accurate crop parameters information timely and accurately for crop fields management and agricultural production decisions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote Sensing in Agriculture · Leaf Properties and Growth Measurement · Greenhouse Technology and Climate Control

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Digital Earth Sciences, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100101, China

University of Chinese Academy of Sciences, Beijing 100049, China

College of Geomatics and Geoinformation, Guilin University of Technology, Guilin 541004, China

Funding

GF6 Project · the National Natural Science Foundation of China · the open fund of the Key Laboratory of Oasis Eco-agriculture, Xinjiang Production and Construction Group

References (85)

Show source-provided references
1. Defining leaf-area index for non-flat leaves10.1111/j.1365-3040.1992.tb00992.x ↗
2. Garrigues, S., Lacaze, R., Baret, F., Morisette, J.T., Weiss, M., Nickeson, J.E., Fernandes, R., Plummer, S., Shabanov, N.V., and Myneni, R.B. (2008). Validation and intercomparison of global Leaf Area Index products derived from remote sensing data. J. Geophys. Res.-Biogeosci., 113.10.1029/2007JG000635 ↗
3. Global synthesis of leaf area index observations: Implications for ecological and remote sensing studies10.1046/j.1466-822X.2003.00026.x ↗
4. Evaluation of the utility of satellite-based vegetation leaf area index data for climate simulations10.1175/1520-0442(2001)014<3536:EOTUOS>2.0.CO;2 ↗
5. Reprocessing the MODIS Leaf Area Index products for land surface and climate modelling10.1016/j.rse.2011.01.001 ↗
6. Impact of leaf area index seasonality on the annual land surface evaporation in a global circulation model
7. Cheng, Z.Q., Meng, J.H., and Wang, Y.M. (2016). Improving spring maize yield estimation at field scale by assimilating time-series HJ-1 CCD data into the WOFOST model using a new method with fast algorithms. Remote Sens., 8.10.3390/rs8040303 ↗
8. (2018, December 13). Systematic Observation Requirements for Satellite-Based Products for Climate 2011 Update: Supplemental Details to the Satellite-Based Component of the “Implementation Plan for the Global Observing System for Climate in Support of the UNFCCC (2010 Update)”. Available online: https://library.wmo.int/index.php?lvl=notice_display&id=12907.
9. Integrating a very fast simulated annealing optimization algorithm for crop leaf area index variational assimilation10.1016/j.mcm.2012.12.013 ↗
10. Using Leaf Area Index, retrieved from optical imagery, in the STICS crop model for predicting yield and biomass of field crops10.1016/j.fcr.2012.02.012 ↗
11. Large-area maize yield forecasting using leaf area index based yield model10.2134/agronj2005.0418 ↗
12. Recent developments in estimating land surface biogeophysical variables from optical remote sensing10.1177/0309133307084626 ↗
13. Optical remote sensing and the retrieval of terrestrial vegetation bio-geophysical properties—A review10.1016/j.isprsjprs.2015.05.005 ↗
14. Verrelst, J., Malenovský, Z., Van der Tol, C., Camps-Valls, G., Gastellu-Etchegorry, J.-P., Lewis, P., North, P., and Moreno, J. (2018). Quantifying vegetation biophysical variables from imaging spectroscopy data: A review on retrieval methods. Surv. Geophys., 1–41.10.1007/s10712-018-9478-y ↗
15. Campos-Taberner, M., Garcia-Haro, F.J., Busetto, L., Ranghetti, L., Martinez, B., Gilabert, M.A., Camps-Valls, G., Camacho, F., and Boschetti, M. (2018). A critical comparison of remote sensing Leaf Area Index estimates over rice-cultivated areas: From Sentinel-2 and Landsat-7/8 to MODIS, GEOV1 and EUMETSAT polar system. Remote Sens., 10.10.3390/rs10050763 ↗
16. Liang, S. (2008). Estimating canopy characteristics from remote sensing observations: Review of methods and associated problems. Advances in Land Remote Sensing: System, Modeling, Inversion and Application, Springer.
17. Implementation of machine-learning classification in remote sensing: An applied review10.1080/01431161.2018.1433343 ↗
18. Machine learning in geosciences and remote sensing10.1016/j.gsf.2015.07.003 ↗
19. Wang, T.T., Xiao, Z.Q., and Liu, Z.G. (2017). Performance evaluation of machine learning methods for Leaf Area Index retrieval from time-series MODIS reflectance data. Sensors, 17.10.3390/s17010081 ↗
20. Noi, P.T., and Kappas, M. (2018). Comparison of random forest, k-nearest neighbor, and support vector machine classifiers for land cover classification using Sentinel-2 imagery. Sensors, 18.10.3390/s18010018 ↗
21. A machine learning method to estimate PM2.5 concentrations across China with remote sensing, meteorological and land use information10.1016/j.scitotenv.2018.04.251 ↗
22. Mathieu, P.-P., and Aubrecht, C. (2018). Machine learning applications for earth observation. Earth Observation Open Science and Innovation, Springer.10.1007/978-3-319-65633-5 ↗
23. Kwon, S.K., Jung, H.S., Baek, W.K., and Kim, D. (2017). Classification of forest vertical structure in South Korea from aerial orthophoto and lidar data using an artificial neural network. Appl. Sci., 7.10.3390/app7101046 ↗
24. Dietterich, T., Bishop, C., Heckerman, D., Jordan, M., and Kearns, M. (2012). Foundations of Machine Learning, MIT Press.
25. Support vector machines regression for retrieval of leaf area index from multiangle imaging spectroradiometer10.1016/j.rse.2006.09.031 ↗
26. Generalizability of gene expression programming and random forest methodologies in estimating cropland and grassland leaf area index10.1016/j.compag.2017.12.007 ↗
27. Retrieval of vegetation biophysical parameters using Gaussian process techniques10.1109/TGRS.2011.2168962 ↗
28. Neural network estimation of LAI, fAPAR, fCover and LAIxC(ab), from top of canopy MERIS reflectance data: Principles and validation10.1016/j.rse.2006.07.014 ↗
29. Li, X., and Bai, R.B. (2016, January 18–20). Freight Vehicle travel time prediction using gradient boosting regression tree. Proceedings of the 2016 15th IEEE International Conference on Machine Learning and Applications, Anaheim, CA, USA.10.1109/ICMLA.2016.0182 ↗
30. Estimation of floodplain aboveground biomass using multispectral remote sensing and nonparametric modeling
31. Xiao, Z.B., Wang, Y., Fu, K., and Wu, F. (2017). Identifying different transportation modes from trajectory data using tree-based ensemble classifiers. ISPRS Int. Geo-Inf., 6.10.3390/ijgi6020057 ↗
32. Derivation of high-resolution leaf area index maps in support of validation activities: Application to the cropland Barrax site10.1016/j.agrformet.2008.07.014 ↗
33. Assessing the impact of China net imports on the world cotton price10.1080/13504851.2014.907468 ↗
34. Coupling effects of water and fertilizer on yield, water and fertilizer use efficiency of drip-fertigated cotton in northern Xinjiang, China10.1016/j.fcr.2018.02.002 ↗
35. ESA (2019, March 30). GMES Sentinel-2 Mission Requirements Document, Technical Report issue 2 revision 1. Available online: http://esamultimedia.esa.int/docs/GMES/Sentinel-2_MRD.pdf.
36. Vujošević, M., and Milijić, S. (2013, January 22–25). The ESA Sentinel-2 Mission Vegetation Variables for Remote Sensing of Plant Monitoring. Proceedings of the 2nd International Conference on Regional Development, Spatial Planning and Strategic Governance (RESPAG 2013), Belgrade, Serbia.
37. A red-edge spectral index for remote sensing estimation of green LAI over agroecosystems10.1016/j.eja.2012.12.001 ↗
38. Estimation of forest leaf area index using vegetation indices derived from Hyperion hyperspectral data10.1109/TGRS.2003.812910 ↗
39. Spatially explicit estimation of leaf area index using EO-1 hyperion and landsat ETM+ data: Implications of spectral bandwidth and shortwave infrared data on prediction accuracy in a tropical montane environment10.2747/1548-1603.45.2.229 ↗
40. ESA (2019, April 06). Copernicus Open Access Hub. Available online: https://scihub.copernicus.eu/dhus/#/home.
41. Louis, J., Debaecker, V., Pflug, B., Main-Knorn, M., Bieniarz, J., Müller-Wilm, U., Cadau, E., and Gascon, F. (2016, January 9–13). SENTINEL-2 SEN2COR: L2A processor for users. Proceedings of the Living Planet Symposium 2016, Prague, Czech Republic.
42. Müller-Wilm, U., Louis, J., Richter, R., Gascon, F., and Niezette, M. (2013, January 9–13). Sentinel-2 Level-2A prototype processor: Architecture, algorithms and first results. Proceedings of the ESA Living Planet Symposium 2013, Edinburgh, UK.
43. Characterization and intercomparison of global moderate resolution leaf area index (LAI) products: Analysis of climatologies and theoretical uncertainties10.1002/jgrg.20051 ↗
44. NASA (2019, April 06). LAADS DAAC, Available online: https://ladsweb.modaps.eosdis.nasa.gov/.
45. ESA (2019, April 06). Copernicus Global Land Service. Available online: https://land.copernicus.eu/global/.
46. Myneni, R., Knyazikhin, Y., and Park, T. (2019, April 06). MCD15A3H MODIS/Terra+Aqua Leaf Area Index/FPAR 4-day L4 Global 500m SIN Grid V006. NASA EOSDIS Land Processes DAAC. Available online: http://doi.org/10.5067/MODIS/MCD15A3H.006.
47. GEOV1: LAI and FAPAR essential climate variables and FCOVER global time series capitalizing over existing products. Part1: Principles of development and production10.1016/j.rse.2012.12.027 ↗
48. Baret, F., Weiss, M., Verger, A., and Smets, B. (2019, March 30). ATBD FOR LAI, FAPAR AND FCOVER FROM PROBA-V PRODUCTS AT 300M RESOLUTION (GEOV3). Available online: https://land.copernicus.eu/global/sites/cgls.vito.be/files/products/ImagineS_RP2.1_ATBD-LAI300m_I1.73.pdf.
49. Scikit-Learn Developers (2019, April 06). Scikit-learn. Available online: https://scikit-learn.org/stable/index.html.
50. Python Software Foundation (2019, April 06). Python. Available online: https://www.python.org/.
51. Scikit-learn: Machine learning in Python
52. Testing the reliability and stability of the internal accuracy assessment of random forest for classifying tree defoliation levels using different validation methods10.1080/10106049.2014.997303 ↗
53. Performance of support vector machines and artificial neural network for mapping endangered tree species using WorldView-2 data in Dukuduku Forest, South Africa10.1109/JSTARS.2015.2461136 ↗
54. Intra-and-inter species biomass prediction in a plantation forest: Testing the utility of high spatial resolution spaceborne multispectral rapideye sensor and advanced machine learning algorithms10.3390/s140815348 ↗
55. Machine learning regression algorithms for biophysical parameter retrieval: Opportunities for Sentinel-2 and -310.1016/j.rse.2011.11.002 ↗
56. Computational foundations of natural intelligence
57. Camps-Valls, G., and Bruzzone, L. (2009). Machine learning techniques in remote sensing data analysis. Kernel Methods for Remote Sensing Data Analysis, John Wiley & Sons.10.1002/9780470748992 ↗
58. Learning representations by back-propagating errors10.1038/323533a0 ↗
59. Multilayer feedforward networks are universal approximators10.1016/0893-6080(89)90020-8 ↗
60. Estimation of rock modulus: For intact rocks with an artificial neural network and for rock masses with a new empirical equation10.1016/j.ijrmms.2005.06.007 ↗
61. Comparative analysis on hidden neurons estimation in multi layer perceptron neural networks for wind speed forecasting10.1007/s10462-016-9506-6 ↗
62. Learning capability and storage capacity of two-hidden-layer feedforward networks10.1109/TNN.2003.809401 ↗
63. Support-vector networks10.1007/BF00994018 ↗
64. Mozer, M.C., Jordan, M.I., and Petsche, T. (1996, January 3–5). Support vector method for function approximation, regression estimation, and signal processing. Proceedings of the 9th International Conference on Neural Information Processing Systems, Denver, CO, USA.
65. Support vector machines in remote sensing: A review10.1016/j.isprsjprs.2010.11.001 ↗
66. Support vector regression
67. Pepper, J., Weiss, S., and Hauke, P. (2015). Efficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers, Apress.
68. Potential of radial basis function based support vector regression for global solar radiation prediction10.1016/j.rser.2014.07.108 ↗
69. Li, M., and Liu, Y.H. (2006, January 15–19). Learning interaction force model for endodontic shaping with support vector regression. Proceedings of the 2006 IEEE International Conference on Robotics and Automation, Orlando, FL, USA.
70. Dietterich, T., Bishop, C., Heckerman, D., Jordan, M., and Kearns, M. (2006). Gaussian Process for Machine Learning, MIT Press.
71. Random forests and Kernel methods10.1109/TIT.2016.2514489 ↗
72. Random forests10.1023/A:1010933404324 ↗
73. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
74. Gradient boosting machines, a tutorial10.3389/fnbot.2013.00021 ↗
75. Arefi, H., and Motagh, M. (2015, January 23–25). Prediction of wind speeds based on digital elevation MODELS using boosted regression trees. Proceedings of the International Conference on Sensors & Models in Remote Sensing & Photogrammetry, Kish Island, Iran.
76. Baeza-Yates, R., Boldi, P., Ribeiro-Neto, B., and Cambazoglu, B.B. (2009, January 9–12). Predicting the readability of short web summaries. Proceedings of the Second ACM International Conference on Web Search and Data Mining, Barcelona, Spain.
77. Measuring and testing dependence by correlation of distances10.1214/009053607000000505 ↗
78. Feature screening via distance correlation learning10.1080/01621459.2012.695654 ↗
79. An iterative approach to distance correlation-based sure independence screening10.1080/00949655.2014.928820 ↗
80. Feature selection through message passing10.1109/TCYB.2016.2609408 ↗
81. An introduction to variable and feature selection
82. Backward elimination model construction for regression and classification using leave-one-out criteria10.1080/00207720601051463 ↗
83. Yuan, H.H., Yang, G.J., Li, C.C., Wang, Y.J., Liu, J.G., Yu, H.Y., Feng, H.K., Xu, B., Zhao, X.Q., and Yang, X.D. (2017). Retrieving soybean Leaf Area Index from unmanned aerial vehicle hyperspectral remote sensing: Analysis of RF, ANN, and SVM regression models. Remote Sens., 9.10.3390/rs9040309 ↗
84. Comparison of different regression models and validation techniques for the assessment of wheat leaf area index from hyperspectral data10.1080/01431161.2015.1084438 ↗
85. Deep learning10.1038/nature14539 ↗