journal article·2019-05-12Open access

An Improved Gradient Boosting Regression Tree Estimation Model for Soil Heavy Metal (Arsenic) Pollution Monitoring Using Hyperspectral Remote Sensing

Lifei Wei, Ziran Yuan, Yanfei Zhong, Lanfang Yang, Xin Hu, Yangxi Zhang

Applied Sciences· Volume 9· Issue 9

Abstract

Hyperspectral remote sensing can be used to effectively identify contaminated elements in soil. However, in the field of monitoring soil heavy metal pollution, hyperspectral remote sensing has the characteristics of high dimensionality and high redundancy, which seriously affect the accuracy and stability of hyperspectral inversion models. To resolve the problem, a gradient boosting regression tree (GBRT) hyperspectral inversion algorithm for heavy metal (Arsenic (As)) content in soils based on Spearman’s rank correlation analysis (SCA) coupled with competitive adaptive reweighted sampling (CARS) is proposed in this paper. Firstly, the CARS algorithm is used to roughly select the original spectral data. Second derivative (SD), Gaussian filtering (GF), and min-max normalization (MMN) pretreatments are then used to improve the correlation between the spectra and As in the characteristic band enhancement stage. Finally, the low-correlation bands are removed using the SCA method, and a subset with absolute correlation values greater than 0.6 is retained as the optimal band subset after each pretreatment. For the modeling, the five most representative characteristic bands were selected in the Honghu area of China, and the nine most representative characteristic bands were selected in the Daye area of China. In order to verify the generalization ability of the proposed algorithm, 92 soil samples from the Honghu and Daye areas were selected as the research objects. With the use of support vector machine regression (SVMR), linear regression (LR), and random forest (RF) regression methods as comparative methods, all the models obtained a good prediction accuracy. However, among the different combinations, CARS-SCA-GBRT obtained the highest precision, which indicates that the proposed algorithm can select fewer characteristic bands to achieve a better inversion effect, and can thus provide accurate data support for the treatment and recovery of heavy metal pollution in soils.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spectroscopy and Chemometric Analyses · Remote-Sensing Image Classification · Geochemistry and Geologic Mapping

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Resources and Environmental Science, Hubei University, Wuhan 430062, China

State Key Laboratory of Information Engineering in Surveying, Mapping and Remote sensing, Wuhan University, Wuhan 430072, China

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · the Special Projects for Technological Innovation in Hubei · the Open Fund of the Key Laboratory of Ministry of Education for Spatial Data Mining and Information Sharing · the Open Fund of the Key Laboratory of Agricultural Remote Sensing of the Ministry of Agriculture

References (31)

Show source-provided references
1. Assessment of Heavy Metal Pollution and Potential Ecological Risks of Urban Soils in Kaifeng City, China
2. Lead and cadmium contamination and exposure risk assessment via consumption of vegetables grown in agricultural soils of five-selected regions of Pakistan10.1016/j.chemosphere.2016.11.152 ↗
3. Visible near infrared reflectance spectroscopy prediction of soil heavy metal concentrations in paper mill biosolid- and liming by-product-amended agricultural soils10.1016/j.geoderma.2016.10.037 ↗
4. Lead and Cadmium in Soils of La Rioja Vineyards, Spain10.1002/ldr.2471 ↗
5. Hu, B., Chen, S., Hu, J., Xia, F., Xu, J.-f., Li, Y., and Shi, Z. (2017). Application of portable XRF and VNIR sensors for rapid assessment of soil heavy metal pollution. PLoS ONE, 12.10.1371/journal.pone.0172438 ↗
6. Estimation of As and Cu Contamination in Agricultural Soils Around a Mining Area by Reflectance Spectroscopy: A Case Study10.1016/S1002-0160(09)60167-3 ↗
7. Comparing different data preprocessing methods for monitoring soil heavy metals based on soil spectral features10.17221/113/2015-SWR ↗
8. Application of Support Vector Machine on Soil Magnesium Content Estimation Based on Hyper-Spectra
9. Hyperspectral inversion of heavy metals in soil of a mining area using extreme learning machine
10. Predicting nickel concentration in soil using reflectance spectroscopy associated with organic matter and clay minerals10.1016/j.geoderma.2018.04.019 ↗
11. An improved estimation model for soil heavy metal(loid) concentration retrieval in mining areas using reflectance spectroscopy10.1007/s11368-018-1930-6 ↗
12. Hybrid Inversion Model of Heavy Metals with Hyperspectral Reflectance in Cultivated Soils of Main Grain Producing Areas
13. Characteristics of soil-vegetable pollution of heavy metals and health risk assessment in Daye mining area
14. Key wavelengths screening using competitive adaptive reweighted sampling method for multivariate calibration10.1016/j.aca.2009.06.046 ↗
15. Wang, X.-h., Chen, J.-y., Zheng, X.-l., Zhu, C., Wang, X.-l., and Shan, C.-z. (2018). Inversion of Cadmium Content in Agriculture Soil Based on SGA-RF Algorithm. Trans. Chin. Soc. Agric. Mach.
16. Additive logistic regression: A statistical view of boosting (With discussion and a rejoinder by the authors)10.1214/aos/1016218223 ↗
17. Zheng, C., Kasprowicz, C.G., and Saunders, C. (2017). Customized Routing Optimization Based on Gradient Boost Regressor Model. arXiv.
18. A hybrid model of self-organizing maps (SOM) and least square support vector machine (LSSVM) for time-series forecasting10.1016/j.eswa.2011.02.107 ↗
19. GIS-based groundwater potential mapping using boosted regression tree, classification and regression tree, and random forest machine learning models in Iran10.1007/s10661-015-5049-6 ↗
20. Estimation of heavy metal concentrations in reclaimed mining soils using reflectance spectroscopy
21. Wang, Y.-y., Qi, Y.-b., Chen, Y., and Xie, F. (2016). Prediction of Soil Organic Matter Based on Multi-resolution Remote Sensing Data and Random Forest Algorithm. Acta Pedol. Sin.
22. Predicting cadmium concentration in soils using laboratory and field reflectance spectroscopy10.1016/j.scitotenv.2018.08.442 ↗
23. Mini-UAV-Borne Hyperspectral Remote Sensing: From Observation and Processing to Applications10.1109/MGRS.2018.2867592 ↗
24. Visible and near-infrared reflectance spectroscopy—An alternative for monitoring soil contamination by heavy metals
25. Surface soil moisture quantification and validation based on hyperspectral data and field measurements10.1117/1.3059191 ↗
26. Pure endmember extraction using robust kernel archetypoid analysis for hyperspectral imagery10.1016/j.isprsjprs.2017.08.001 ↗
27. A Poisson nonnegative matrix factorization method with parameter subspace clustering constraint for endmember extraction in hyperspectral imagery10.1016/j.isprsjprs.2017.03.004 ↗
28. Estimating soil zinc concentrations using reflectance spectroscopy
29. State Environmental Protection Administration of China (1995). Environmental Quality Standard for Soils (GB15618-1995), Standards Press of China.
30. Reflectance Spectroscopy (Vis-NIR) for Assessing Soil Heavy Metals Concentrations Determined by two Different Analytical Protocols, Based on ISO 11466 and ISO 14869-110.1007/s11270-017-3609-9 ↗
31. Graph-Regularized Fast and Robust Principal Component Analysis for Hyperspectral Band Selection