Tomato Maturity Classification and Fruit Counting Based on RGB and Multispectral Images
Source abstract
Abstract
Accurate monitoring of tomato maturity and fruit number is essential for improving crop management and supporting accurate yield estimation in greenhouse environments. However, variations in lighting conditions, occlusions, and overlapping fruits often make reliable maturity classification and fruit counting challenging. This paper presents an integrated approach for tomato maturity classification and fruit number estimation using RGB and multispectral images. The proposed approach consists of tomato detection, tomato tracking and counting, and maturity classification of tomatoes. The detection model identifies tomatoes in each frame, the tracking module associates individual tomatoes across image sequences to avoid duplicate counting, and the classification models determine maturity levels. Experiments are conducted on three tomato datasets collected in greenhouse environments. The results show that the proposed method achieves a maximum maturity classification accuracy of 81%. In addition, the proposed approach facilitates consistent fruit counting across image sequences, supporting practical applications in greenhouse monitoring. These findings demonstrate the potential of integrating RGB and multispectral information for automated tomato maturity classification and fruit counting in precision agriculture.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Remote Sensing in Agriculture · Greenhouse Technology and Climate Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, National Taipei University of Technology, Taipei 10608, Taiwan
Department of Electrical Engineering, National Chung Cheng University, Chiayi 621301, Taiwan
Department of Computer Science and Information Engineering, National United University, Miaoli 360302, Taiwan
Funding
National Science and Technology Council of Taiwan
References (36)
Show source-provided references
1. Hyperspectral imaging analysis for ripeness evaluation of strawberry with support vector machine10.1016/j.jfoodeng.2016.01.002 ↗
2. Zhao, C., and Li, X. (2021). A multispectral image based object detection approach in natural scene. Proceedings of the 2021 International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China, 9–11 April 2021, IEEE.10.1109/ICSP51882.2021.9408975 ↗
3. Detection of mulberry maturity stages using deep learning models10.1109/ACCESS.2021.3096550 ↗
4. Machine learning application for predicting the strawberry harvesting time10.7744/kjoas.20190026 ↗
5. Detection of citrus fruit and tree trunks in natural environments using a multi-elliptical boundary model10.1016/j.compind.2018.03.007 ↗
6. Cherry-harvesting robot10.1016/j.compag.2008.01.018 ↗
7. Niedbała, G., Kurek, J., Świderski, B., Wojciechowski, T., Antoniuk, I., and Bobran, K. (2022). Prediction of blueberry (Vaccinium corymbosum L.) yield based on artificial intelligence methods. Agriculture, 12.10.3390/agriculture12122089 ↗
8. Determination of optimal harvest boundaries for honeycrisp™ fruit using a new chlorophyll meter10.4141/cjps2013-241 ↗
9. Li, J., Wang, P., and Zhao, Y. (2023). Application of YOLOv8 for crop detection in precision agriculture. Sensors, 23.10.3390/s23208361 ↗
10. Wang, T., Zhang, L., and Sun, Q. (2024). Improved YOLOv8-based tomato detection method in greenhouse environments. Agriculture, 14.10.3390/agronomy14081764 ↗
11. Chen, I.T., and Lin, H.Y. Detection, counting and maturity assessment of cherry tomatoes using multi-spectral images and machine learning techniques. Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020), Valletta, Malta, 27–29 February 2020, SciTePress, Science and Technology Publications.10.5220/0008874907590766 ↗
12. Afonso, M., Fonteijn, H., Fiorentin, F.S., Lensink, D., Mooij, M., Faber, N., Polder, G., and Wehrens, R. (2020). Tomato fruit detection and counting in greenhouses using deep learning. Front. Plant Sci., 11.10.3389/fpls.2020.571299 ↗
13. Comparison of convolutional neural networks in fruit detection and counting: A comprehensive evaluation10.1016/j.compag.2020.105348 ↗
14. Aggregation signature for small object tracking10.1109/TIP.2019.2940477 ↗
15. Rincon, D.R., van Henten, E.J., and Kootstra, G. (2022). Development and evaluation of automated localization and reconstruction of all fruits on tomato plants in a greenhouse based on multi-view perception and 3D multi-object tracking. arXiv.
16. Zhao, Q., and Tao, H. (2005). Object tracking using color correlogram. Proceedings of the 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, Beijing, China, 15–16 October 2005, IEEE.
17. Zhao, D., Fu, H., Xiao, L., Wu, T., and Dai, B. (2018). Multi-object tracking with correlation filter for autonomous vehicle. Sensors, 18.10.3390/s18072004 ↗
18. Ristani, E., Solera, F., Zou, R., Cucchiara, R., and Tomasi, C. (2016). Performance measures and a data set for multi-target, multi-camera tracking. Proceedings of the 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands, 11–14 October 2016, Springer.10.1007/978-3-319-48881-3_2 ↗
19. Geiger, A., Lenz, P., and Urtasun, R. (2012). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, IEEE.10.1109/CVPR.2012.6248074 ↗
20. Classification of cape gooseberry fruit according to its level of ripeness using machine learning techniques and different color spaces10.1109/ACCESS.2019.2898223 ↗
21. Using machine learning techniques for evaluating tomato ripeness10.1016/j.eswa.2014.09.057 ↗
22. A novel vegetation index for coffee ripeness monitoring using aerial imagery10.3390/rs13020263 ↗
23. Rouse, J.W., Haas, R.H., Schell, J.A., and Deering, D.W. (1974). Monitoring vegetation systems in the great plains with ERTS, Proceedings of the Third Earth Resources Technology Satellite-1 Symposium, Greenbelt, MD, USA, 10–14 December 1973.
24. Spectral and thermal sensing for nitrogen and water status in rainfed and irrigated wheat environments10.1007/s11119-006-9011-z ↗
25. A machine vision-based maturity prediction system for sorting of harvested mangoes10.1109/TIM.2014.2299527 ↗
26. Recognising blueberry fruit of different maturity using histogram oriented gradients and colour features in outdoor scenes10.1016/j.biosystemseng.2018.08.011 ↗
27. Waseem, M., Huang, C.H., Sajjad, M.M., Naqvi, L.H., Majeed, Y., Rehman, T.U., and Nadeem, T. (2025). Automated tomato maturity estimation using an optimized residual model with pruning and quantization techniques. arXiv.
28. Zhou, K., Yang, Y., Cavallaro, A., and Xiang, T. (2019). Omni-scale feature learning for person re-identification. arXiv.10.1109/ICCV.2019.00380 ↗
29. Du, Y., Zhao, Z., Song, Y., Zhao, Y., Su, F., Gong, T., and Meng, H. (2023). Strongsort: Make deepsort great again. arXiv.10.1109/TMM.2023.3240881 ↗
30. Wojke, N., Bewley, A., and Paulus, D. (2017). Simple online and realtime tracking with a deep association metric. arXiv.10.1109/ICIP.2017.8296962 ↗
31. Sari, Y.A., and Adinugroho, S. (2017). Tomato ripeness clustering using 6-means algorithm based on v-channel otsu segmentation. Proceedings of the 2017 International Symposium on Computational and Business Intelligence (ISCBI), Dubai, United Arab Emirates, 11–14 August 2017, IEEE.10.1109/ISCBI.2017.8053539 ↗
32. An improved Otsu threshold segmentation algorithm
33. Pai, C.A., and Lin, H.Y. (2024, January 25–27). Maturity and yield estimation of tomatoes using RGB and multispectral images. Proceedings of the 2024 IEEE International Conference on Industrial Technology (ICIT 2024), Bristol, UK.10.1109/ICIT58233.2024.10540838 ↗
34. A survey of iris datasets10.1016/j.imavis.2021.104109 ↗
35. Fu, Y., Li, W., Li, G., Dong, Y., Wang, S., Zhang, Q., Li, Y., and Dai, Z. (2024). Multi-stage tomato fruit recognition method based on improved YOLOv8. Front. Plant Sci., 15.10.3389/fpls.2024.1447263 ↗
36. Liu, Y., Han, X., Zhang, H., Liu, S., Ma, W., Yan, Y., Sun, L., Jing, L., Wang, Y., and Wang, J. (2025). YOLOv8-MSP-PD: A lightweight YOLOv8-based detection method for Jinxiu Malus fruit in field conditions. Agronomy, 15.10.3390/agronomy15071581 ↗