journal article·2022-01-11Open access

Density Estimates as Representations of Agricultural Fields for Remote Sensing-Based Monitoring of Tillage and Vegetation Cover

Markku Luotamo, Maria Yli-Heikkilä, Arto Klami

Applied Sciences· Volume 12· Issue 2

Abstract

We consider the use of remote sensing for large-scale monitoring of agricultural land use, focusing on classification of tillage and vegetation cover for individual field parcels across large spatial areas. From the perspective of remote sensing and modelling, field parcels are challenging as objects of interest due to highly varying shape and size but relatively uniform pixel content and texture. To model such areas we need representations that can be reliably estimated already for small parcels and that are invariant to the size of the parcel. We propose representing the parcels using density estimates of remote imaging pixels and provide a computational pipeline that combines the representation with arbitrary supervised learning algorithms, while allowing easy integration of multiple imaging sources. We demonstrate the method in the task of the automatic monitoring of autumn tillage method and vegetation cover of Finnish crop fields, based on the integrated analysis of intensity of Synthetic Aperture Radar (SAR) polarity bands of the Sentinel-1 satellite and spectral indices calculated from Sentinel-2 multispectral image data. We use a collection of 127,757 field parcels monitored in April 2018 and annotated to six tillage method and vegetation cover classes, reaching 70% classification accuracy for test parcels when using both SAR and multispectral data. Besides this task, the method could also directly be applied for other agricultural monitoring tasks, such as crop yield prediction.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote Sensing in Agriculture · Soil Geostatistics and Mapping · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, University of Helsinki, 00014 Helsinki, Finland

Natural Resources Institute Finland, 31600 Jokioinen, Finland

Department of Geosciences and Geography, University of Helsinki, 00014 Helsinki, Finland

References (65)

Show source-provided references
1. Crop type classification using a combination of optical and radar remote sensing data: A review10.1080/01431161.2019.1569791 ↗
2. Felegari, S., Sharifi, A., Moravej, K., Amin, M., Golchin, A., Muzirafuti, A., Tariq, A., and Zhao, N. (2021). Integration of Sentinel 1 and Sentinel 2 Satellite Images for Crop Mapping. Appl. Sci., 11.10.3390/app112110104 ↗
3. Recurrent-based regression of Sentinel time series for continuous vegetation monitoring10.1016/j.rse.2021.112419 ↗
4. Mateo-García, G., Gómez-Chova, L., and Camps-Valls, G. (2017, January 23–28). Convolutional neural networks for multispectral image cloud masking. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA.10.1109/IGARSS.2017.8127438 ↗
5. Deep learning classification of land cover and crop types using remote sensing data10.1109/LGRS.2017.2681128 ↗
6. Multiscale Cloud Detection in Remote Sensing Images Using a Dual Convolutional Neural Network10.1109/TGRS.2020.3015272 ↗
7. Fu, G., Liu, C., Zhou, R., Sun, T., and Zhang, Q. (2017). Classification for high resolution remote sensing imagery using a fully convolutional network. Remote Sens., 9.10.3390/rs9050498 ↗
8. Accurate crop-type classification using multi-temporal optical and multi-polarization SAR data in an object-based image analysis framework10.1080/01431161.2017.1317933 ↗
9. Providing crop information using RADARSAT-1 and satellite optical imagery10.1080/01431160110070753 ↗
10. Self-attention for raw optical Satellite Time Series Classification10.1016/j.isprsjprs.2020.06.006 ↗
11. Voormansik, K., Zalite, K., Sünter, I., Tamm, T., Koppel, K., Verro, T., Brauns, A., Jakovels, D., and Praks, J. (2020). Separability of Mowing and Ploughing Events on Short Temporal Baseline Sentinel-1 Coherence Time Series. Remote Sens., 12.10.3390/rs12223784 ↗
12. De Vroey, M., Radoux, J., and Defourny, P. (2021). Grassland Mowing Detection Using Sentinel-1 Time Series: Potential and Limitations. Remote Sens., 13.10.3390/rs13030348 ↗
13. Planque, C., Lucas, R., Punalekar, S., Chognard, S., Hurford, C., Owers, C., Horton, C., Guest, P., King, S., and Williams, S. (2021). National Crop Mapping Using Sentinel-1 Time Series: A Knowledge-Based Descriptive Algorithm. Remote Sens., 13.10.3390/rs13050846 ↗
14. Color indexing10.1007/BF00130487 ↗
15. Schiele, B., and Crowley, J.L. (1996, January 25–29). Probabilistic object recognition using multidimensional receptive field histograms. Proceedings of the IEEE 13th International Conference on Pattern Recognition, Washington, DC, USA.10.1109/ICPR.1996.546722 ↗
16. Barla, A., Odone, F., and Verri, A. (2003, January 14–18). Histogram intersection kernel for image classification. Proceedings of the IEEE 2003 International Conference on Image Processing, Barcelona, Spain.
17. Zhang, G., Jia, X., and Kwok, N.M. (2012, January 22–27). Super pixel based remote sensing image classification with histogram descriptors on spectral and spatial data. Proceedings of the 2012 IEEE International Geoscience and Remote Sensing Symposium, Munich, Germany.10.1109/IGARSS.2012.6351708 ↗
18. Two-stage clustering technique based on the neighboring union histogram for hyperspectral remote sensing images
19. Histogram-based attribute profiles for classification of very high resolution remote sensing images10.1109/TGRS.2015.2496167 ↗
20. Simonoff, J.S. (2012). Smoothing Methods in Statistics, Springer Science & Business Media.
21. Scott, D.W. (2015). Multivariate Density Estimation: Theory, Practice, and Visualization, John Wiley & Sons.10.1002/9781118575574 ↗
22. Laplace approximation for logistic Gaussian process density estimation and regression
23. Water quality consequences of conservation tillage: New technology is needed to improve the water quality advantages of conservation tillage
24. Bechmann, M.E., and Bøe, F. (2021). Soil tillage and crop growth effects on surface and subsurface runoff, loss of soil, phosphorus and nitrogen in a cold climate. Land, 10.10.3390/land10010077 ↗
25. Discriminating Crop Residues from Soil by Shortwave Infrared Reflectance10.2134/agronj2001.931125x ↗
26. Remote sensing of crop residue cover and soil tillage intensity10.1016/j.still.2005.11.013 ↗
27. Quemada, M., and Daughtry, C.S.T. (2016). Spectral Indices to Improve Crop Residue Cover Estimation under Varying Moisture Conditions. Remote Sens., 8.10.3390/rs8080660 ↗
28. Identification of Agricultural Tillage Practices from C-Band Radar Backscatter10.1080/07038992.1996.10874649 ↗
29. Defining the Sensitivity of Multi-Frequency and Multi-Polarized Radar Backscatter to Post-Harvest Crop Residue10.1080/07038992.2001.10854941 ↗
30. The effect of soil and crop residue characteristics on polarimetric radar response10.1016/S0034-4257(01)00312-1 ↗
31. Multi-source remote sensing data fusion: Status and trends10.1080/19479830903561035 ↗
32. Sentinel-1A SAR and Sentinel-2A MSI data fusion for urban ecosystem service mapping
33. Object-based fusion of multitemporal multiangle ENVISAT ASAR and HJ-1B multispectral data for urban land-cover mapping10.1109/TGRS.2012.2236560 ↗
34. Understanding the temporal behavior of crops using Sentinel-1 and Sentinel-2-like data for agricultural applications10.1016/j.rse.2017.07.015 ↗
35. Orynbaikyzy, A., Gessner, U., Mack, B., and Conrad, C. (2020). Crop type classification using fusion of Sentinel-1 and Sentinel-2 data: Assessing the impact of feature selection, optical data availability, and parcel sizes on the accuracies. Remote Sens., 12.10.3390/rs12172779 ↗
36. Satellite mapping of tillage practices in the North Central US region from 2005 to 201610.1016/j.rse.2018.11.010 ↗
37. Denize, J., Hubert-Moy, L., Betbeder, J., Corgne, S., Baudry, J., and Pottier, E. (2019). Evaluation of Using Sentinel-1 and -2 Time-Series to Identify Winter Land Use in Agricultural Landscapes. Remote Sens., 11.10.3390/rs11010037 ↗
38. Finnish Meteorological Institute (2021, February 08). Sentinel-1 SAR-Image Mosaic (S1sar). Available online: https://ckan.ymparisto.fi/dataset/sentinel-1-sar-image-mosaic-s1sar-sentinel-1-sar-kuvamosaiikki-s1sar.
39. European Space Agency (2021, February 08). Sentinel-1 SAR Interferometric Wide Swath. Available online: https://sentinels.copernicus.eu/web/sentinel/user-guides/sentinel-1-sar/acquisition-modes/interferometric-wide-swath.
40. European Space Agency (2021, March 26). Level-2A Algorithm Overview/NDVI. Available online: https://sentinels.copernicus.eu/web/sentinel/technical-guides/sentinel-2-msi/level-2a/algorithm.
41. Using thematic mapper data to identify contrasting soil plains and tillage practices
42. Accessing the temporal and spectral features in crop type mapping using multi-temporal Sentinel-2 imagery: A case study of Yi’an County, Heilongjiang province, China10.1016/j.compag.2020.105618 ↗
43. On estimation of a probability density function and mode10.1214/aoms/1177704472 ↗
44. A fast and objective multidimensional kernel density estimation method: FastKDE10.1016/j.csda.2016.02.014 ↗
45. Density estimation, stochastic processes and prior information10.1111/j.2517-6161.1978.tb01655.x ↗
46. Towards a faster implementation of density estimation with logistic Gaussian process priors10.1198/106186007X210206 ↗
47. Stan: A probabilistic programming language10.18637/jss.v076.i01 ↗
48. Van Tricht, K., Gobin, A., Gilliams, S., and Piccard, I. (2018). Synergistic Use of Radar Sentinel-1 and Optical Sentinel-2 Imagery for Crop Mapping: A Case Study for Belgium. Remote Sens., 10.10.20944/preprints201808.0066.v1 ↗
49. Vreugdenhil, M., Wagner, W., Bauer-Marschallinger, B., Pfeil, I., Teubner, I., Rüdiger, C., and Strauss, P. (2018). Sensitivity of Sentinel-1 Backscatter to Vegetation Dynamics: An Austrian Case Study. Remote Sens., 10.10.3390/rs10091396 ↗
50. Vreugdenhil, M., Navacchi, C., Bauer-Marschallinger, B., Hahn, S., Steele-Dunne, S., Pfeil, I., Dorigo, W., and Wagner, W. (2020). Sentinel-1 Cross Ratio and Vegetation Optical Depth: A Comparison over Europe. Remote Sens., 12.10.3390/rs12203404 ↗
51. Deep Recurrent Neural Networks for Winter Vegetation Quality Mapping via Multitemporal SAR Sentinel-110.1109/LGRS.2018.2794581 ↗
52. Denize, J., Hubert-Moy, L., and Pottier, E. (2019). Polarimetric SAR Time-Series for Identification of Winter Land Use. Sensors, 19.10.3390/s19245574 ↗
53. Integration of optical and Synthetic Aperture Radar (SAR) imagery for delivering operational annual crop inventories10.1016/j.isprsjprs.2008.07.006 ↗
54. Inglada, J., Vincent, A., Arias, M., and Marais-Sicre, C. (2016). Improved Early Crop Type Identification By Joint Use of High Temporal Resolution SAR And Optical Image Time Series. Remote Sens., 8.10.3390/rs8050362 ↗
55. Torbick, N., Huang, X., Ziniti, B., Johnson, D., Masek, J., and Reba, M. (2018). Fusion of Moderate Resolution Earth Observations for Operational Crop Type Mapping. Remote Sens., 10.10.3390/rs10071058 ↗
56. Crop type mapping without field-level labels: Random forest transfer and unsupervised clustering techniques10.1016/j.rse.2018.12.026 ↗
57. John, G.H., and Langley, P. (2013). Estimating continuous distributions in Bayesian classifiers (orig. 1995). arXiv.
58. Gramacki, A. (2018). Nonparametric Kernel Density Estimation and Its Computational Aspects, Springer.10.1007/978-3-319-71688-6 ↗
59. Titsias, M.K. (2009, January 16–18). Variational Learning of Inducing Variables in Sparse Gaussian Processes. Proceedings of the 12th International Conference on Artificial Intelligence and Statistics, Clearwater Beach, FL, USA.
60. Bayesian density estimation and inference using mixtures10.1080/01621459.1995.10476550 ↗
61. Deng, X., López-Martínez, C., Chen, J., and Han, P. (2017). Statistical Modeling of Polarimetric SAR Data: A Survey and Challenges. Remote Sens., 9.10.3390/rs9040348 ↗
62. SAR image segmentation based on level set with stationary global minimum10.1109/LGRS.2008.2001768 ↗
63. Nielsen, A.A., Skriver, H., and Conradsen, K. (2007, January 18–20). Complex Wishart Distribution Based Analysis of Polarimetric Synthetic Aperture Radar Data. Proceedings of the IEEE 2007 International Workshop on the Analysis of Multi-temporal Remote Sensing Images, Leuven, Belgium.10.1109/MULTITEMP.2007.4293078 ↗
64. Parallel implementation of polarimetric synthetic aperture radar data processing for unsupervised classification using the complex Wishart classifier10.1109/JSTARS.2015.2471083 ↗
65. Surface water body detection in polarimetric SAR data using contextual complex Wishart classification10.1029/2019WR025192 ↗