journal article·2021-04-07Open access

Yielding Multi-Fold Training Strategy for Image Classification of Imbalanced Weeds

Vo Hoang Trong, Yu Gwang Hyun, Kim Jin Young, Pham The Bao

Applied Sciences· Volume 11· Issue 8

Abstract

An imbalanced dataset is a significant challenge when training a deep neural network (DNN) model for deep learning problems, such as weeds classification. An imbalanced dataset may result in a model that behaves robustly on major classes and is overly sensitive to minor classes. This article proposes a yielding multi-fold training (YMufT) strategy to train a DNN model on an imbalanced dataset. This strategy reduces the bias in training through a min-class-max-bound procedure (MCMB), which divides samples in the training set into multiple folds. The model is consecutively trained on each one of these folds. In practice, we experiment with our proposed strategy on two small (PlantSeedlings, small PlantVillage) and two large (Chonnam National University (CNU), large PlantVillage) weeds datasets. With the same training configurations and approximate training steps used in conventional training methods, YMufT helps the DNN model to converge faster, thus requiring less training time. Despite a slight decrease in accuracy on the large dataset, YMufT increases the F1 score in the NASNet model to 0.9708 on the CNU dataset and 0.9928 when using the Mobilenet model training on the large PlantVillage dataset. YMufT shows outstanding performance in both accuracy and F1 score on small datasets, with values of (0.9981, 0.9970) using the Mobilenet model for training on small PlantVillage dataset and (0.9718, 0.9689) using Resnet to train on the PlantSeedlings dataset. Grad-CAM visualization shows that conventional training methods mainly concentrate on high-level features and may capture insignificant features. In contrast, YMufT guides the model to capture essential features on the leaf surface and properly localize the weeds targets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Smart Agriculture and AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of ICT Convergence System Engineering, Chonnam National University, Gwangju 61186, Korea

Faculty of Information Technology, Saigon University, Ho Chi Minh City 72710, Vietnam

Funding

Rural Development Administration, Republic of Korea

References (41)

Show source-provided references
1. Maeda-Gutiérrez, V., Galván-Tejada, C.E., Zanella-Calzada, L.A., Celaya-Padilla, J.M., Galván-Tejada, J.I., Gamboa-Rosales, H., Luna-García, H., Magallanes-Quintanar, R., Guerrero Méndez, C.A., and Olvera-Olvera, C.A. (2020). Comparison of Convolutional Neural Network Architectures for Classification of Tomato Plant Diseases. Appl. Sci., 10.10.3390/app10041245 ↗
2. Shang, G., Liu, G., Zhu, P., Han, J., Xia, C., and Jiang, K. (2021). A Deep Residual U-Type Network for Semantic Segmentation of Orchard Environments. Appl. Sci., 11.10.3390/app11010322 ↗
3. Oh, S.-j., Jung, M.-j., Lim, C., and Shin, S.-c. (2020). Automatic Detection of Welding Defects Using Faster R-CNN. Appl. Sci., 10.10.3390/app10238629 ↗
4. Cinbis, R.G., Verbeek, J., and Schmid, C. (2014, January 23–28). Multi-fold mil training for weakly supervised object localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.309 ↗
5. A systematic study of the class imbalance problem in convolutional neural networks10.1016/j.neunet.2018.07.011 ↗
6. Learning from Imbalanced Data10.1109/TKDE.2008.239 ↗
7. An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics10.1016/j.ins.2013.07.007 ↗
8. Class imbalance revisited: A new experimental setup to assess the performance of treatment methods10.1007/s10115-014-0794-3 ↗
9. Influence of resampling on accuracy of imbalanced classification10.1117/12.2228523 ↗
10. Cao, K., Wei, C., Gaidon, A., Arechiga, N., and Ma, T. (2019, January 8–14). Learning imbalanced datasets with la-bel-distribution-aware margin loss. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
11. Chawla, N.V. (2009). Data mining for imbalanced datasets: An overview. Data Mining and Knowledge Discovery Handbook, Springer.10.1007/978-0-387-09823-4_45 ↗
12. A Cost-Sensitive Deep Belief Network for Imbalanced Classification10.1109/TNNLS.2018.2832648 ↗
13. Chain based sampling for monotonic imbalanced classifica-tion10.1016/j.ins.2018.09.062 ↗
14. A classification method based on feature selection for imbalanced data10.1109/ACCESS.2019.2923846 ↗
15. Shu, J., Xie, Q., Yi, L., Zhao, Q., Zhou, S., Xu, Z., and Meng, D. (2019). Meta-weight-net: Learning an explicit mapping for sample weighting. Advances in Neural Information Processing Systems, Springer.
16. Using sub-sampling and ensemble clustering techniques to improve per-formance of imbalanced classification10.1016/j.neucom.2017.06.082 ↗
17. A Distance-Based Weighted Undersampling Scheme for Support Vector Machines and its Application to Imbalanced Classification10.1109/TNNLS.2017.2755595 ↗
18. Imbalanced classification problems: Systematic study, issues and best practices
19. Deep normalized convolutional neural network for imbalanced fault classifi-cation of machinery and its understanding via visualization10.1016/j.ymssp.2018.03.025 ↗
20. Imbalanced deep learning by minority class incremental rectification10.1109/TPAMI.2018.2832629 ↗
21. Mullick, S.S., Datta, S., and Das, S. (November, January 27). Generative Adversarial Minority Oversampling. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea.
22. Deep reinforcement learning for imbalanced classification10.1007/s10489-020-01637-z ↗
23. Late fusion of multimodal deep neural networks for weeds classification10.1016/j.compag.2020.105506 ↗
24. AgroAVNET for crops and weeds classification: A step forward in auto-matic farming10.1016/j.compag.2018.09.021 ↗
25. Rahman, N.R., Hasan, A.M., and Shin, J. (2020, January 28–29). Performance Comparison of Different Convolutional Neural Network Architectures for Plant Seedling Classification. Proceedings of the 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT), Dhaka, Bangladesh.10.1109/ICAICT51780.2020.9333468 ↗
26. A convolutional fuzzy min-max neural network10.1016/j.neucom.2020.04.003 ↗
27. Plant-Seedling Classification Using Transfer Learning-Based Deep Con-volutional Neural Networks10.4018/IJAEIS.2020100102 ↗
28. Identification of plant disease images via a squeeze-and-excitation MobileNet model and twice transfer learning10.1049/ipr2.12090 ↗
29. A comparative study of fine-tuning deep learning models for plant disease identification10.1016/j.compag.2018.03.032 ↗
30. Performance analysis of nonlinear activation func-tion in convolution neural network for image classification
31. Using Deep Learning for Image-Based Plant Disease Detection10.3389/fpls.2016.01419 ↗
32. Brahimi, M., Arsenovic, M., Laraba, S., Sladojevic, S., Boukhalfa, K., and Moussaoui, A. (2018). Deep Learning for Plant Diseases: Detection and Saliency Map Visualisation. Human and Machine Learning, Human–Computer Interaction Series, Springer.10.1007/978-3-319-90403-0_6 ↗
33. Survey on deep learning with class imbalance10.1186/s40537-019-0192-5 ↗
34. Cost-Sensitive Learning of Deep Feature Representations from Imbalanced Data10.1109/TNNLS.2017.2732482 ↗
35. Finding the Best Classification Threshold in Imbalanced Classification10.1016/j.bdr.2015.12.001 ↗
36. Giselsson, T.M., Dyrmann, M., Jorgensen, R.N., Jensen, P.K., and Midtiby, H.S. (2017). A Public Image Database for Benchmark of Plant Seedling Classification Algorithms. arXiv.
37. J, A.P., and Gopal, G. (2019). Data for: Identification of Plant Leaf Diseases Using a 9-layer Deep Convolutional Neural Network. Mendeley Data.
38. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
39. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
40. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–23). Learning transferable architectures for scalable image recogni-tion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
41. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗