Effect of Hyperparameter Tuning on the Performance of YOLOv8 for Multi Crop Classification on UAV Images
Source abstract
Abstract
This study investigates the performance of YOLOv8, a Convolutional Neural Network (CNN) architecture, for multi-crop classification in a mixed farm with Unmanned Aerial Vehicle (UAV) imageries. Emphasizing hyperparameter optimization, specifically batch size, the study’s primary objective is to refine the model’s batch size for improved accuracy and efficiency in crop detection and classification. Using the Google Colaboratory platform, the YOLOv8 model was trained over various batch sizes (10, 20, 30, 40, 50, 60, 70, 80, and 90) to automatically identify the five different classes (sugarcane, banana trees, spinach, pepper, and weeds) present on the UAV images. The performance of the model was assessed using classification accuracy, precision, and recall with the aim of identifying the optimal batch size. The results indicate a substantial improvement in classifier performance from batch sizes of 10 up to 60, while significant dips and peaks were recorded at batch sizes 70 to 90. Based on the analysis of the obtained results, Batch size 60 emerged with the best overall performance for automatic crop detection and classification. Although the F1 score was moderate, the combination of high accuracy, precision, and recall makes it the most balanced option. However, Batch Size 80 also shows very high precision (98%) and balanced recall (84%), which is suitable if the primary focus is on achieving high precision. The findings demonstrate the robustness of YOLOv8 for automatic crop identification and classification in a mixed crop farm while highlighting the significant impact of tuning to the appropriate batch size on the model’s overall performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Smart Agriculture and AI · Advanced Neural Network Applications · Remote Sensing in Agriculture
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Land and Spatial Sciences, Namibia University of Science and Technology, Windhoek Private Bag 13388, Namibia
Department of Surveying and Geoinformatics, Federal University of Technology Minna, Minna P.M.B. 65, Niger State, Nigeria
References (32)
Show source-provided references
1. Differing visions of agriculture: Industrial-chemical vs. small farm and urban organic production10.1111/ajes.12344 ↗
2. Deep learning techniques to classify agricultural crops through UAV imagery: A review10.1007/s00521-022-07104-9 ↗
3. Hall, O., Dahlin, S., Marstorp, H., Archila Bustos, M.F., Öborn, I., and Jirström, M. (2018). Classification of Maize in Complex Smallholder Farming Systems Using UAV Imagery. Drones, 2.10.3390/drones2030022 ↗
4. Dhanaraju, M., Chenniappan, P., Ramalingam, K., Pazhanivelan, S., and Kaliaperumal, R. (2022). Smart Farming: Internet of Things (IoT)-Based Sustainable Agriculture. Agriculture, 12.10.3390/agriculture12101745 ↗
5. Crop Classification in Mixed Farming Systems
6. He, S., Peng, P., Chen, Y., and Wang, X. (2022). Multi-Crop Classification Using Feature Selection-Coupled Machine Learning Classifiers Based on Spectral, Textural and Environmental Features. Remote Sens., 14.10.3390/rs14133153 ↗
7. Evaluation of CNN model by comparing with convolutional autoencoder and deep neural network for crop classification on hyperspectral imagery10.1080/10106049.2020.1740950 ↗
8. Precision Agriculture: A New Era in Farming
9. Feng, Q., Yang, J., Liu, Y., Ou, C., Zhu, D., Niu, B., Liu, J., and Li, B. (2020). Multi-temporal unmanned aerial vehicle remote sensing for vegetable mapping using an attention-based recurrent convolutional neural network. Remote Sens., 12.10.3390/rs12101668 ↗
10. Monteiro, A., Santos, S., and Gonçalves, P. (2021). Precision Agriculture for Crop and Livestock Farming—Brief Review. Animals, 11.10.3390/ani11082345 ↗
11. Csillik, O., Cherbini, J., Johnson, R., Lyons, A., and Kelly, M. (2018). Identification of citrus trees from unmanned aerial vehicle imagery using convolutional neural networks. Drones, 2.10.3390/drones2040039 ↗
12. Siesto, G., Fernández-Sellers, M., and Lozano-Tello, A. (2021). Crop Classification of Satellite Imagery Using Synthetic Multitemporal and Multispectral Images in Convolutional Neural Networks. Remote Sens., 13.10.3390/rs13173378 ↗
13. Using Machine Learning Algorithm and Landsat Time Series to Identify Establishment Year of Para Rubber Plantations: A Case Study in Thalang District, Phuket Island, Thailand10.1080/01431161.2020.1799450 ↗
14. Patel, R. (2019, January 9–12). Crop Classification Using Deep Learning. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.
15. Performance evaluation of YOLO v5 model for automatic crop and weed classification on UAV images10.1016/j.atech.2023.100231 ↗
16. Hyperparameter optimization method based on dynamic Bayesian with sliding balance mechanism in neural network for cloud computing10.1186/s13677-023-00482-y ↗
17. Impact of training set batch size on the performance of convolutional neural networks for diverse datasets
18. Keskar, N.S., Mudigere, D., Nocedal, J., Smelyanskiy, M., and Tang, P.T.P. (2016, January 2–4). On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. Proceedings of the 2016 International Conference on Learning Representations (ICLR), San Juan, Puerto Rico.
19. Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch, A., Jia, Y., and He, K. (2017). Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour. arXiv.
20. Smith, S.L., Kindermans, P.J., Ying, C., and Le, Q.V. (May, January 30). Don’t Decay the Learning Rate, Increase the Batch Size. Proceedings of the 6th International Conference on Learning Representations, Vancouver, BC, Canada. Available online: https://openreview.net/pdf?id=B1Yy1BxCZ.
21. You, Y., Gitman, I., and Ginsburg, B. (2017, January 21–26). Large Batch Training of Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
22. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
23. Applicability of artificial neural network for automatic crop type classification on UAV-based images10.4314/etsj.v13i1.5 ↗
24. Effects of Varying Training Epochs of a Faster Region-Based Convolutional Neural Network on the Accuracy of an Automatic Weed Classification Scheme10.1016/j.atech.2022.100128 ↗
25. A review of the use of convolutional neural networks in agriculture10.1017/S0021859618000436 ↗
26. Corceiro, A., Alibabaei, K., Assunção, E., Gaspar, P.D., and Pereira, N. (2023). Methods for Detecting and Classifying Weeds, Diseases and Fruits Using AI to Improve the Sustainability of Agricultural Crops: A Review. Processes, 11.10.3390/pr11041263 ↗
27. Qu, H.-R., and Su, W.-H. (2024). Deep Learning-Based Weed–Crop Recognition for Smart Agricultural Equipment: A Review. Agronomy, 14.10.3390/agronomy14020363 ↗
28. Infrared Object Detection Method Based on DBD-YOLOv810.1109/ACCESS.2023.3345889 ↗
29. Drone-based crop type identification with convolutional neural networks: An evaluation of the performance of RESNET architectures10.5194/isprs-annals-X-1-W1-2023-991-2023 ↗
30. Vegetable disease detection using an improved YOLOv8 algorithm in the greenhouse plant environment10.1038/s41598-024-54540-9 ↗
31. Ma, N., Su, Y., Yang, L., Li, Z., and Yan, H. (2024). Wheat Seed Detection and Counting Method Based on Improved YOLOv8 Model. Sensors, 24.10.3390/s24051654 ↗
32. Optimizing crop classification in precision agriculture using AlexNet and high resolution UAV imagery