journal article·2024-04-25Open access

Optimizing Cattle Behavior Analysis in Precision Livestock Farming: Integrating YOLOv7-E6E with AutoAugment and GridMask to Enhance Detection Accuracy

Hyeon-seok Sim, Tae-kyeong Kim, Chang-woo Lee, Chang-sik Choi, Jin Soo Kim, Hyun-chong Cho

Applied Sciences· Volume 14· Issue 9

Abstract

Recently, the growing demand for meat has increased interest in precision livestock farming (PLF), wherein monitoring livestock behavior is crucial for assessing animal health. We introduce a novel cattle behavior detection model that leverages data from 2D RGB cameras. It primarily employs you only look once (YOLO)v7-E6E, which is a real-time object detection framework renowned for its efficiency across various applications. Notably, the proposed model enhances network performance without incurring additional inference costs. We primarily focused on performance enhancement and evaluation of the model by integrating AutoAugment and GridMask to augment the original dataset. AutoAugment, a reinforcement learning algorithm, was employed to determine the most effective data augmentation policy. Concurrently, we applied GridMask, a novel data augmentation technique that systematically eliminates square regions in a grid pattern to improve model robustness. Our results revealed that when trained on the original dataset, the model achieved a mean average precision (mAP) of 88.2%, which increased by 2.9% after applying AutoAugment. The performance was further improved by combining AutoAugment and GridMask, resulting in a notable 4.8% increase in the mAP, thereby achieving a final mAP of 93.0%. This demonstrates the efficacy of these augmentation strategies in improving cattle behavior detection for PLF.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Animal Behavior and Welfare Studies · Food Supply Chain Traceability · Human-Animal Interaction Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department Graduate Program for BIT Medical Convergence, Kangwon National University, Chuncheon 24341, Republic of Korea

Gangwon State Livestock Research Institute, Hoengseong-gun 25266, Republic of Korea

College of Animal Life Sciences, Kangwon National University, Chuncheon 24341, Republic of Korea

Department of Electronics Engineering, Kangwon National University, Chuncheon 24341, Republic of Korea

Funding

National Research Foundation of Korea (NRF) funded by the Ministry of Education · Rural Development Administration, Republic of Korea

References (32)

Show source-provided references
1. Socioeconomic and demographic drivers of red and processed meat consumption: Implications for health and environmental sustainability10.1017/S0029665116000100 ↗
2. OECD (2024). Meat Consumption (Indicator), OECD.
3. Technology and responsibility: A discussion of underexamined risks and concerns in precision livestock farming10.1093/af/vfz056 ↗
4. General introduction to precision livestock farming10.2527/af.2017.0102 ↗
5. Monitoring and classification of cattle behavior: A survey10.1016/j.atech.2022.100091 ↗
6. A systematic literature review on the use of machine learning in precision livestock farming10.1016/j.compag.2020.105826 ↗
7. Exploring the potential of precision livestock farming technologies to help address farm animal welfare10.3389/fanim.2021.639678 ↗
8. Pavlovic, D., Davison, C., Hamilton, A., Marko, O., Atkinson, R., Michie, C., Crnojević, V., Andonovic, I., Bellekens, X., and Tachtatzis, C. (2021). Classification of cattle behaviours using neck-mounted accelerometer-equipped collars and convolutional neural networks. Sensors, 21.10.3390/s21124050 ↗
9. Classification of dairy cow excretory events using a tail-mounted accelerometer10.1016/j.compag.2022.107187 ↗
10. Image analysis for individual identification and feeding behaviour monitoring of dairy cows based on Convolutional Neural Networks (CNN)10.1016/j.biosystemseng.2020.07.019 ↗
11. Lameness detection of dairy cows based on the YOLOv3 deep learning algorithm and a relative step size characteristic vector10.1016/j.biosystemseng.2019.11.017 ↗
12. Detection of aggressive behaviours in pigs using a RealSence depth sensor10.1016/j.compag.2019.105003 ↗
13. Accurate body measurement of live cattle using three depth cameras and non-rigid 3-D shape recovery10.1016/j.compag.2020.105821 ↗
14. Wurtz, K., Camerlink, I., D’Eath, R.B., Fernández, A.P., Norton, T., Steibel, J., and Siegford, J. (2019). Recording behaviour of indoor-housed farm animals automatically using machine vision technology: A systematic review. PLoS ONE, 14.10.1371/journal.pone.0226669 ↗
15. Real-time sow behavior detection based on deep learning10.1016/j.compag.2019.104884 ↗
16. Wang, R., Gao, Z., Li, Q., Zhao, C., Gao, R., Zhang, H., Li, S., and Feng, L. (2022). Detection method of cow estrus behavior in natural scenes based on improved YOLOv5. Agriculture, 12.10.3390/agriculture12091339 ↗
17. Precision livestock farming: Building ‘digital representations’ to bring the animals closer to the farmer10.1017/S175173111900199X ↗
18. The Ethics of Touch and the Importance of Nonhuman Relationships in Animal Agriculture10.1007/s10806-021-09852-5 ↗
19. Cubuk, E.D., Zoph, B., Mane, D., Vasudevan, V., and Le, Q.V. (2019, January 15–20). Autoaugment: Learning augmentation strategies from data. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00020 ↗
20. Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report.
21. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
22. DeVries, T., and Taylor, G.W. (2017). Improved regularization of convolutional neural networks with cutout. arXiv.
23. Singh, K.K., Yu, H., Sarmasi, A., Pradeep, G., and Lee, Y.J. (2018). Hide-and-seek: A data augmentation technique for weakly-supervised localization and beyond. arXiv.
24. Chen, P., Liu, S., Zhao, H., and Jia, J. (2020). Gridmask data augmentation. arXiv.
25. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
26. Wang, C.Y., Liao HY, M., and Yeh, I.H. (2022). Designing network design strategies through gradient path analysis. arXiv.
27. YOLO-BYTE: An efficient multi-object tracking algorithm for automatic monitoring of dairy cows10.1016/j.compag.2023.107857 ↗
28. Livestock farmers’ working conditions in agroecological farming systems. A review10.1007/s13593-021-00679-y ↗
29. Precision Livestock Farming technologies in pasture-based livestock systems10.1016/j.animal.2021.100429 ↗
30. CORDIS (2024, April 07). Final Report Summary—EU-PLF (Bright Farm by Precision Livestock Farming). Available online: https://cordis.europa.eu/project/id/311825/reporting.
31. Deep learning-based hierarchical cattle behavior recognition with spatio-temporal information10.1016/j.compag.2020.105627 ↗
32. Uchino, T., and Ohwada, H. (2021, January 29–31). Individual identification model and method for estimating social rank among herd of dairy cows using YOLOv5. Proceedings of the 2021 IEEE 20th International Conference on Cognitive Informatics & Cognitive Computing (ICCI* CC), Banff, AB, Canada.10.1109/ICCICC53683.2021.9811319 ↗