journal article·2023-07-15Open access

Predicting the Quality of Tangerines Using the GCNN-LSTM-AT Network Based on Vis–NIR Spectroscopy

Yiran Wu, Xinhua Zhu, Qiangsheng Huang, Yuan Zhang, Julian Evans, Sailing He

Applied Sciences· Volume 13· Issue 14

Abstract

Fruit quality assessment plays a crucial role in determining their market value, consumer acceptance, and post-harvest management. In recent years, spectroscopic techniques have gained significant attention as non-destructive methods for evaluating fruit quality. In this study, we propose a novel deep-learning network, called GCNN-LSTM-AT, for the prediction of five important parameters of tangerines using visible and near-infrared spectroscopy (Vis–NIR). The quality attributes include soluble solid content (SSC), total acidity (TA), acid–sugar ratio (A/S), firmness, and Vitamin C (VC). The proposed model combines the strengths of graph convolutional network (GCN), convolutional neural networks (CNNs), and long short-term memory (LSTM) to capture both spatial and sequential dependencies in the spectra data, and incorporates an attention mechanism to enhance the discriminative ability of the model. To investigate the effectiveness and stability of the model, comparisons with three traditional machine-learning algorithms—moving window partial least squares (MWPLS), random forest (RF), and support vector regression (SVR)—and two deep neural networks—DeepSpectra2D and CNN-AT—are provided. The results have shown that the GCNN-LSTM-AT network outperforms other algorithms and models, achieving accurate predictions for SSC (R2: 0.9885, RMSECV: 0.1430 ∘Brix), TA (R2: 0.8075, RMSECV: 0.0868%), A/S (R2: 0.9014, RMSECV: 1.9984), firmness (R2: 0.9472, RMSECV: 0.0294 kg), and VC (R2: 0.7386, RMSECV: 29.4104 mg/100 g) of tangerines.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spectroscopy and Chemometric Analyses · Date Palm Research Studies · Smart Agriculture and AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Engineering Research Center for Optical Instruments, Center for Optical and Electromagnetic Research, Zhejiang University, Hangzhou 310058, China

Shanghai Institute for Advanced Study, Zhejiang University, Shanghai 201203, China

Funding

National Natural Science Foundation of China · “Pioneer” and “Leading Goose” R&D Program of Zhejiang Province · Ningbo Science and Technology Project

References (35)

Show source-provided references
1. Portable 4D Snapshot Hyperspectral Imager for Fastspectral and Surface Morphology Measurements10.2528/PIER22021702 ↗
2. Nondestructive measurement of fruit and vegetable quality by means of NIR spectroscopy: A review10.1016/j.postharvbio.2007.06.024 ↗
3. Application of Vis/NIR spectroscopy for predicting sweetness and flavour parameters of ‘Valencia’ orange (Citrus sinensis) and ‘Star Ruby’ grapefruit (Citrus × paradisi Macfad)10.1016/j.jfoodeng.2016.08.015 ↗
4. Abbaspour-Gilandeh, Y., and Soltani Nazarloo, A. (2022). Non-Destructive Measurement of Quality Parameters of Apple Fruit by Using Visible/Near-Infrared Spectroscopy and Multivariate Regression Analysis. Sustainability, 14.10.3390/su142214918 ↗
5. Grabska, J., Beć, K., Ueno, N., and Huck, C. (2023). Analyzing the Quality Parameters of Apples by Spectroscopy from Vis/NIR to NIR Region: A Comprehensive Review. Foods, 12.10.3390/foods12101946 ↗
6. Prediction of a wide range of compounds concentration in raw coffee beans using NIRS, PLS and variable selection10.1016/j.foodcont.2021.107967 ↗
7. An improved variable selection method for support vector regression in NIR spectral modeling10.1016/j.jprocont.2017.06.001 ↗
8. Determination of SSC and TA content of pear by Vis-NIR spectroscopy combined CARS and RF algorithm10.1504/IJWMC.2021.119061 ↗
9. Nondestructive prediction model of internal hardness attribute of fig fruit using NIR spectroscopy and RF10.1007/s11042-021-10777-4 ↗
10. Developing deep learning based regression approaches for determination of chemical compositions in dry black goji berries (Lycium ruthenicum Murr.) using near-infrared hyperspectral imaging10.1016/j.foodchem.2020.126536 ↗
11. Feature visualization of Raman spectrum analysis with deep convolutional neural network10.1016/j.aca.2019.08.064 ↗
12. Modeling for SSC and firmness detection of persimmon based on NIR hyperspectral imaging by sample partitioning and variables selection10.1016/j.infrared.2019.103099 ↗
13. Deep Neural Networks for Image Super-Resolution in Optical Microscopy by Using Modified Hybrid Task Cascade U-Net10.2528/PIER21110904 ↗
14. Deep Learning Approach Based Optical Edge Detection Using Enz Layers (Invited)10.2528/PIER22061403 ↗
15. Food and agro-product quality evaluation based on spectroscopy and deep learning: A review10.1016/j.tifs.2021.04.008 ↗
16. DeepSpectra: An end-to-end deep learning approach for quantitative spectral analysis10.1016/j.aca.2019.01.002 ↗
17. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
18. Near infrared spectroscopy quantification based on Bi-LSTM and transfer learning for new scenarios10.1016/j.saa.2022.121759 ↗
19. Fast detection of cumin and fennel using NIR spectroscopy combined with deep learning algorithms10.1016/j.ijleo.2021.167080 ↗
20. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
21. Distinguishing bipolar depression from major depressive disorder using fnirs and deep neural network10.2528/PIER20102202 ↗
22. Effective band selection of hyperspectral image by an attention mechanism-based convolutional network10.1039/D1RA07662K ↗
23. Deep learning for vibrational spectral analysis: Recent progress and a practical guide10.1016/j.aca.2019.06.012 ↗
24. Near Infrared Spectroscopy: Fundamentals, practical aspects and analytical applications10.1590/S0103-50532003000200006 ↗
25. Caballero, B., Finglas, P.M., and Toldrá, F. (2016). Encyclopedia of Food and Health, Academic Press.
26. Linearization and Scatter-Correction for Near-Infrared Reflectance Spectra of Meat10.1366/0003702854248656 ↗
27. Smoothing and Differentiation of Data by Simplified Least Squares Procedures10.1021/ac60214a047 ↗
28. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
29. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
30. Xu, B., Wang, N., Chen, T., and Li, M. (2015). Empirical Evaluation of Rectified Activations in Convolutional Network. arXiv.
31. Kipf, T.N., and Welling, M. (2016). Semi-Supervised Classification with Graph Convolutional Networks. arXiv.
32. Wavelength Interval Selection in Multicomponent Spectral Analysis by Moving Window Partial Least-Squares Regression with Applications to Mid-Infrared and Near-Infrared Spectroscopic Data10.1021/ac011177u ↗
33. Model Comparisons and R2
34. The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation10.7717/peerj-cs.623 ↗
35. Spiess, A.N., and Neumeyer, N. (2010). An evaluation of R2 as an inadequate measure for nonlinear models in pharmacological and biochemical research: A Monte Carlo approach. BMC Pharmacol., 10.10.1186/1471-2210-10-6 ↗