journal article·2023-06-02Open access

Research on an Improved Non-Destructive Detection Method for the Soluble Solids Content in Bunch-Harvested Grapes Based on Deep Learning and Hyperspectral Imaging

Junhong Zhao, Qixiao Hu, Bin Li, Yuming Xie, Huazhong Lu, Sai Xu

Applied Sciences· Volume 13· Issue 11

Abstract

The soluble solids content (SSC) is one of the important evaluation indicators for the internal quality of fresh grapes. However, the current non-destructive detection method based on hyperspectral imaging (HSI) relies on manual operation and is relatively cumbersome, making it difficult to achieve automatic detection in batches. Therefore, in this study, we aimed to conduct research on an improved non-destructive detection method for the SSC of bunch-harvested grapes. This study took the Shine-Muscat grape as the research object. Using Mask R-CNN to establish a grape image segmentation model based on deep learning (DL) applied to near-infrared hyperspectral images (400~1000 nm), 35 characteristic wavelengths were selected using Monte Carlo Uninformative Variable Elimination (MCUVE) to establish a prediction model for SSC. Based on the two abovementioned models, the improved non-destructive detection method for the SSC of bunch-harvested grapes was validated. The comprehensive evaluation index F1 of the image segmentation model was 95.34%. The Rm2 and RMSEM of the SSC prediction model were 0.8705 and 0.5696 Brix%, respectively, while the Rp2 and RMSEP were 0.8755 and 0.9177 Brix%, respectively. The non-destructive detection speed of the improved method was 16.6 times that of the existing method. These results prove that the improved non-destructive detection method for the SSC of bunch-harvested grapes based on DL and HSI is feasible and efficient.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spectroscopy and Chemometric Analyses · Advanced Chemical Sensor Technologies · Spectroscopy Techniques in Biomedical and Chemical Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Agriculture, Guangdong Academy of Agricultural Sciences, Guangzhou 510640, China

Guangdong Laboratory for Lingnan Modern Agriculture, Guangzhou 510640, China

College of Engineering, South China Agricultural University, Guangzhou 510642, China

Guangdong Academy of Agricultural Sciences, Guangzhou 510640, China

Funding

Laboratory of Lingnan Modern Agriculture Project · The Project of Collaborative Innovation Center of Guangdong Academy of Agricultural Sciences · 2020 Provincial Agricultural Science and Technology Innovation and Extension System Construction Project · President’s Foundation of Guangdong Academy of Agricultural Sciences

References (40)

Show source-provided references
1. Current status and prospects of the development of grape industry in China
2. The international trade and domestic demand of the table grape industry in China
3. Research on Grading Evaluation of ‘Shine–Muscat’ Grape Fruit Quality
4. Analysis and comparison of fruit quality of various shape grape varieties
5. Principles and Applications of Hyperspectral Imaging Technique in Quality and Safety Inspection of Fruits and Vegetables
6. A new quantitative index for the assessment of tomato quality using Vis-NIR hyperspectral imaging10.1016/j.foodchem.2022.132864 ↗
7. Study on Non-Detective Determination of β-Carotene Content in Loquats with Raman Spectroscopy
8. Research on simultaneous detection of SSC and FI of blueberry based on hyperspectral imaging combined MS-SPA10.1016/j.eaef.2019.11.006 ↗
9. Identification of Varieties of Dried Red Jujubes with Near-Infrared Hyperspectral Imaging
10. Using hyperspectral imaging technology and machine learning algorithms for assessing internal quality parameters of apple fruits10.1016/j.chemolab.2022.104650 ↗
11. Gomes, V., Rendall, R., Reis, M.S., Mendesferreira, A., and Melopinto, P. (2021). Determination of Sugar, pH, and Anthocyanin Contents in Port Wine Grape Berries through Hyperspectral Imaging: An Extensive Comparison of Linear and Non-Linear Predictive Methods. Appl. Sci., 11.10.3390/app112110319 ↗
12. Hyperspectral image information fusion-based detection of soluble solids content in red globe grapes10.1016/j.compag.2022.106822 ↗
13. Liu, B. (2020). Research on Non-Destructive Detection of Table Grape Internal Qualities Based on Hyperspectral Imaging Technology. [Master’s Thesis, Shandong Agricultural University].
14. Detection of Soluble Solids Content of Postharvest Grape Based on Hyperspectral Imaging
15. Design and test of portable comprehensive quality non-destructive detector for grape bunches based on spectrum10.1016/j.jfutfo.2022.06.010 ↗
16. Kalopesa, E., Karyotis, K., Tziolas, N., Tsakiridis, N., Samarinas, N., and Zalidis, G. (2023). Estimation of Sugar Content in Wine Grapes via In Situ VNIR–SWIR Point Spectroscopy Using Explainable Artificial Intelligence Techniques. Sensors, 23.10.3390/s23031065 ↗
17. Recognition and the optimal picking point location of grape stems based on deep learning
18. Review of image semantic segmentation based on deep learning
19. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
20. Research Progress of Image Sensing and Deep Learning in Agriculture
21. LabelMe: A Database and Web-Based Tool for Image Annotation10.1007/s11263-007-0090-8 ↗
22. Carvalho, O.L.F.D., de Carvalho, J.O.A., Albuquerque, A.O.D., Bem, P.P.D., Silva, C.R., Ferreira, P.H.G., Moura, R.D.S.D., Gomes, R.A.T., Guimarães, R.F., and Borges, D.L. (2020). Instance Segmentation for Large, Multi-Channel Remote Sensing Imagery Using Mask-RCNN and a Mosaicking Approach. Remote Sens., 13.10.3390/rs13010039 ↗
23. Zhang, Y., Chu, J., Leng, L., and Miao, J. (2020). Mask-Refined R-CNN: A Network for Refining Object Details in Instance Segmentation. Sensors, 20.10.3390/s20041010 ↗
24. Oh, H.Y., Khan, M.S., Jeon, S.B., and Jeong, M.-H. (2022). Automated Detection of Greenhouse Structures Using Cascade Mask R-CNN. Appl. Sci., 12.10.3390/app12115553 ↗
25. Studies on banana fruit quality and maturity stages using hyperspectral imaging10.1016/j.jfoodeng.2011.05.002 ↗
26. Xiao, H., Feng, L., Song, D., Tu, K., Peng, J., and Pan, L. (2019). Grading and Sorting of Grape Berries Using Visible-Near Infrared Spectroscopy on the Basis of Multiple Inner Quality Parameters. Sensors, 19.10.3390/s19112600 ↗
27. Study on outlier detection method of the near infrared spectroscopy analysis by probability metric10.1016/j.saa.2022.121473 ↗
28. A New Damage Index Based on Statistical Features, PCA, and Mahalanobis Distance for Detecting and Locating Cables Loss in a Cable-Stayed Bridge10.1142/S0219455421501273 ↗
29. Jiang, H., Zhang, C., He, Y., Chen, X., Liu, F., and Liu, Y. (2016). Wavelength Selection for Detection of Slight Bruises on Pears Based on Hyperspectral Imaging. Appl. Sci., 6.10.3390/app6120450 ↗
30. Near infrared reflectance spectrometry classification of cigarettes using the successive projections algorithm for variable selection10.1016/j.talanta.2009.05.031 ↗
31. Variables selection methods in near-infrared spectroscopy10.1016/j.aca.2010.03.048 ↗
32. Han, Q., Wu, H., and Yu, R. (2007). Collection of Abstracts of the 9th National Conference on Computer Chemistry of China, Sichuan University Publishing House.
33. The collinearity problem in linear regression. The partial least squares (PLS) approach to generalized inverses10.1137/0905052 ↗
34. Gabrielli, M., Lançonverdier, V., Picouet, P., and Maury, C. (2021). Hyperspectral Imaging to Characterize Table Grapes. Chemosensors, 9.10.3390/chemosensors9040071 ↗
35. He, F., Liu, T., and Tao, D. (2019). Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, Inc. (NeurIPS).
36. Yang, J. (2016). Study on Grapes’ Internal Quality Detection Base on Hyperspectral Imaging Technology. [Master’s Thesis, Shihezi University].
37. Wavelength selection with a view to a simplified handheld optical system to estimate grape ripeness10.5344/ajev.2013.13024 ↗
38. Assessment of the quality parameters in grapes using VIS/NIR spectroscopy10.1016/j.biosystemseng.2010.02.002 ↗
39. First steps towards the development of a non-destructive technique for the quality control of wine grapes during on-vine ripening and on arrival at the winery10.1016/j.jfoodeng.2010.06.016 ↗
40. Changes in different maturity indices of Cabernet Sauvignon (Vitis vinifera L.) grape after veraison