Comparison of Image Preprocessing Strategies for Convolutional Neural Network-Based Growth Stage Classification of Butterhead Lettuce in Industrial Plant Factories
Source abstract
Abstract
The increasing need for scalable and efficient crop monitoring systems in industrial plant factories calls for image-based deep learning models that are both accurate and robust to domain variability. This study investigates the feasibility of CNN-based growth stage classification of butterhead lettuce (Lactuca sativa L.) using two data types: raw images and images processed through GrabCut–Watershed segmentation. A ResNet50-based transfer learning model was trained and evaluated on each dataset, and cross-domain performance was assessed to understand generalization capability. Models trained and tested within the same domain achieved high accuracy (Model 1: 99.65%; Model 2: 97.75%). However, cross-domain evaluations revealed asymmetric performance degradation—Model 1-CDE (trained on raw images, tested on preprocessed images) achieved 82.77% accuracy, while Model 2-CDE (trained on preprocessed images, tested on raw images) dropped to 34.15%. Although GrabCut–Watershed offered clearer visual inputs, it limited the model’s ability to generalize due to reduced contextual richness and oversimplification. In terms of inference efficiency, Model 2 recorded the fastest model-only inference time (0.037 s/image), but this excluded the segmentation step. In contrast, Model 1 achieved 0.055 s/image without any additional preprocessing, making it more viable for real-time deployment. Notably, Model 1-CDE combined the fastest inference speed (0.040 s/image) with stable cross-domain performance, while Model 2-CDE was both the slowest (0.053 s/image) and least accurate. Grad-CAM visualizations further confirmed that raw image-trained models consistently attended to meaningful plant structures, whereas segmentation-trained models often failed to localize correctly in cross-domain tests. These findings demonstrate that training with raw images yields more robust, generalizable, and deployable models. The study highlights the importance of domain consistency and preprocessing trade-offs in vision-based agricultural systems and lays the groundwork for lightweight, real-time AI applications in smart farming.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Leaf Properties and Growth Measurement · Greenhouse Technology and Climate Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Biosystems Engineering, Seoul National University, Seoul 08826, Republic of Korea
Integrated Major in Global Smart Farm, Seoul National University, Seoul 08826, Republic of Korea
Institute of Agriculture and Life Sciences, Seoul National University, Seoul 08826, Republic of Korea
Funding
Korea Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry (IPET) through the Technology Commercialization Support Program · Ministry of Agriculture, Food and Rural Affairs (MAFRA)
References (42)
Show source-provided references
1. The shrinking land challenge10.1021/acsagscitech.2c00250 ↗
2. Understanding and enhancing soil biological health: The solution for reversing soil degradation10.3390/su7010988 ↗
3. Major trends in population growth around the world10.46234/ccdcw2021.160 ↗
4. World population prospects: The 2015 revision
5. Future food-production systems: Vertical farming and controlled-environment agriculture
6. Martinez, J. (2025, May 25). Controlled Environment Agriculture: A Systematic Review, Food Safety, Available online: https://www.food-safety.com/articles/9386-controlled-environment-agriculture-a-systematic-review.
7. The history and advanced technology of plant factories10.2525/ecb.53.47 ↗
8. Luna-Maldonado, A.I., Vidales-Contreras, J.A., and Rodríguez-Fuentes, H. (2016). Advances and trends in development of plant factories. Front. Plant Sci., 7.10.3389/fpls.2016.01848 ↗
9. Machine vision technology for agricultural applications10.1016/S0168-1699(02)00100-X ↗
10. Liu, Y., Mousavi, S., Pang, Z., Ni, Z., Karlsson, M., and Gong, S. (2021). Plant factory: A new playground of industrial communication and computing. Sensors, 22.10.3390/s22010147 ↗
11. Meng, Y., Xu, M., Yoon, S., Jeong, Y., and Park, D.S. (2022). Flexible and high quality plant growth prediction with limited data. Front. Plant Sci., 13.10.3389/fpls.2022.989304 ↗
12. Nidamanuri, R.R. (2024). Deep learning-based prediction of plant height and crown area of vegetable crops using LiDAR point cloud. Sci. Rep., 14.10.1038/s41598-024-65322-8 ↗
13. Kim, J.S.G., Moon, S., Park, J., Kim, T., and Chung, S. (2024). Development of a machine vision-based weight prediction system of butterhead lettuce (Lactuca sativa L.) using deep learning models for industrial plant factory. Front. Plant Sci., 15.10.3389/fpls.2024.1365266 ↗
14. Colonna, R., Genzano, N., Ciancia, E., Filizzola, C., Fiorentino, C., D’Antonio, P., and Tramutoli, V. (2024). A Method to Determine the Optimal Period for Field-Scale Yield Prediction Using Sentinel-2 Vegetation Indices. Land, 13.10.3390/land13111818 ↗
15. Du, L., Yang, H., Song, X., Wei, N., Yu, C., Wang, W., and Zhao, Y. (2022). Estimating leaf area index of maize using UAV-based digital imagery and machine learning methods. Sci. Rep., 12.10.1038/s41598-022-20299-0 ↗
16. Tan, S., Liu, J., Lu, H., Lan, M., Yu, J., Liao, G., Wang, Y., Li, Z., Qi, L., and Ma, X. (2022). Machine learning approaches for rice seedling growth stages detection. Front. Plant Sci., 13.10.3389/fpls.2022.914771 ↗
17. Wang, H., Chang, W., Yao, Y., Yao, Z., Zhao, Y., Li, S., Liu, Z., and Zhang, X. (2023). Cropformer: A new generalized deep learning classification approach for multi-scenario crop classification. Front. Plant Sci., 14.10.3389/fpls.2023.1130659 ↗
18. Worth, L., Rodgers, M., and Reardon, A. (2025, May 25). Butterhead Lettuce—Butterhead Lettuce Variety Performance Trial in in a Hydroponic NFT System. Available online: https://docs.lib.purdue.edu/cgi/viewcontent.cgi?article=1237&context=mwvtr.
19. Schwartz, P.A., Anderson, T.S., and Timmons, M.B. (2019). Predictive equations for butterhead lettuce (Lactuca sativa, cv. flandria) root surface area grown in aquaponic conditions. Horticulturae, 5.10.3390/horticulturae5020039 ↗
20. Alejandrino, J., Concepcion, R., Lauguico, S., Tobias, R.R., Almero, V.J., Puno, J.C., Bandala, A., Dadios, E., and Flores, R. (2020, January 16–19). Visual classification of lettuce growth stage based on morphological attributes using unsupervised machine learning models. Proceedings of the 2020 IEEE REGION 10 CONFERENCE (TENCON), Osaka, Japan.10.1109/TENCON50793.2020.9293854 ↗
21. Seri’Aisyah, H. (2019). Pattern Recognition of Lettuce Varieties with Machine Learning, University of Malaya.
22. Pang, S., Thio, T.H.G., Siaw, F.L., Chen, M., and Xia, Y. (2024). Research on Improved Image Segmentation Algorithm Based on GrabCut. Electronics, 13.10.3390/electronics13204068 ↗
23. Recognizing the Indian Cautionary Traffic Signs using GAN, Improved Mask R-CNN, and Grab Cut10.1002/cpe.7453 ↗
24. Grabcut-based human segmentation in video sequences10.3390/s121115376 ↗
25. Huang, X., Wang, S., Gao, X., Luo, D., Xu, W., Pang, H., and Zhou, M. (2023). An H-grabcut image segmentation algorithm for indoor pedestrian background removal. Sensors, 23.10.3390/s23187937 ↗
26. Integration of automated grabcut algorithm with DeepLabv3+ to enhance image segmentation for accurate leaf disease detection and classification
27. Identification of Different Food Grains by Extracting Colour and Structural Features using Image Segmentation Techniques10.17485/ijst/2017/v10i25/113722 ↗
28. Liu, X., and Aldrich, C. (2022). Deep learning approaches to image texture analysis in material processing. Metals, 12.10.3390/met12020355 ↗
29. Review on the recent welding research with application of CNN-based deep learning part I: Models and applications10.5781/JWJ.2021.39.1.1 ↗
30. A review paper about deep learning for medical image analysis10.1155/2023/7091301 ↗
31. Liu, J., Wu, C.H., Wang, Y., Xu, Q., Zhou, Y., Huang, H., Wang, C., Cai, S., Ding, Y., and Fan, H. (2019, January 15–20). Learning raw image denoising with bayer pattern unification and bayer preserving augmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00259 ↗
32. A comparative analysis of machine learning algorithms modeled from machine vision-based lettuce growth stage classification in smart aquaponics10.18178/ijesd.2020.11.9.1288 ↗
33. Chiu, M.T., Xu, X., Wei, Y., Huang, Z., Schwing, A.G., Brunner, R., and Shi, H. (2020, January 13–19). Agriculture-vision: A large aerial image database for agricultural pattern analysis. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00290 ↗
34. An industrial-grade solution for agricultural image classification tasks10.1016/j.compag.2021.106253 ↗
35. Optimal training strategy for high-performance detection model of multi-cultivar tea shoots based on deep learning methods10.1016/j.scienta.2024.112949 ↗
36. Barman, R., Deshpande, S., Agarwal, S., Inamdar, U., Devare, M., and Patil, A. (2019, January 9–15). Transfer learning for small dataset. Proceedings of the National Conference on Machine Learning, Long Beach, CA, USA.
37. Mukti, I.Z., and Biswas, D. (2019, January 20–22). Transfer learning based plant diseases detection using ResNet50. Proceedings of the 2019 4th International Conference on Electrical Information and Communication Technology, Khulna, Bangladesh.10.1109/EICT48899.2019.9068805 ↗
38. Sarku, E., Steele, J., Ruffin, T., Gokaraju, B., and Karimodini, A. (2021, January 10–13). Reducing data costs—Transfer learning based traffic sign classification approach. Proceedings of the SoutheastCon 2021, Atlanta, GA, USA.10.1109/SoutheastCon45413.2021.9401900 ↗
39. Masters, D., and Luschi, C. (2018). Revisiting small batch training for deep neural networks. arXiv.
40. Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. Neural Networks: Tricks of the Trade, Springer. [2nd ed.].10.1007/978-3-642-35289-8_26 ↗
41. Lewkowycz, A. (2021). How to decay your learning rate. arXiv.
42. Gang, M.S., Kim, H.J., and Kim, D.W. (2022). Estimation of greenhouse lettuce growth indices based on a two-stage CNN using RGB-D images. Sensors, 22.10.3390/s22155499 ↗