Imbalanced Data Parameter Optimization of Convolutional Neural Networks Based on Analysis of Variance
Source abstract
Abstract
Classifying imbalanced data is important due to the significant practical value of accurately categorizing minority class samples, garnering considerable interest in many scientific domains. This study primarily uses analysis of variance (ANOVA) to investigate the main and interaction effects of different parameters on imbalanced data, aiming to optimize convolutional neural network (CNN) parameters to improve minority class sample recognition. The CIFAR-10 and Fashion-MNIST datasets are used to extract samples with imbalance ratios of 25:1, 15:1, and 1:1. To thoroughly assess model performance on imbalanced data, we employ various evaluation metrics, such as accuracy, recall, F1 score, P-mean, and G-mean. In highly imbalanced datasets, optimizing the learning rate significantly affects all performance metrics. The interaction between the learning rate and kernel size significantly impacts minority class samples in moderately imbalanced datasets. Through parameter optimization, the accuracy of the CNN model on the 25:1 highly imbalanced CIFAR-10 and Fashion-MNIST datasets improves by 14.20% and 5.19% compared to the default model and by 8.21% and 3.87% compared to the undersampling model, respectively, while also enhancing other evaluation metrics for minority classes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Imbalanced Data Classification Techniques · Anomaly Detection Techniques and Applications · Vehicle License Plate Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematical Science, Heilongjiang University, Harbin 150080, China
Funding
Project of “Double First-Class” Disciplines in Heilongjiang Province
References (41)
Show source-provided references
1. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2018). AlexNet: ImageNet classification with deep convolutional neural networks. Proc. NIPS, 1097–1105.
2. A hybrid intelligent system for medical data classification10.1016/j.eswa.2013.09.022 ↗
3. Alam, T.M., Shaukat, K., Khan, W.A., Hameed, I.A., Almuqren, L.A., Raza, M.A., Aslam, M., and Luo, S. (2022). An efficient deep learning-based skin cancer classifier for an imbalanced dataset. Diagnostics, 12.10.3390/diagnostics12092115 ↗
4. Awoyemi, J.O., Adetunmbi, A.O., and Oluwadare, S.A. (2017, January 29–31). Credit card fraud detection using machine learning techniques: A comparative analysis. Proceedings of the 2017 International Conference on Computing Networking and Informatics (ICCNI), Lagos, Nigeria.10.1109/ICCNI.2017.8123782 ↗
5. Imbalanced data fault diagnosis of hydrogen sensors using deep convolutional generative adversarial network with convolutional neural network10.1063/5.0057059 ↗
6. Survey on deep learning with class imbalance10.1186/s40537-019-0192-5 ↗
7. Drummond, C., and Holte, R.C. (2003, January 21). C4. 5, class imbalance, and cost sensitivity: Why under-sampling beats over-sampling. Proceedings of the Workshop on Learning from Imbalanced Datasets II, Washington, DC, USA.
8. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
9. The foundations of cost-sensitive learning
10. A review on ensembles for the class imbalance problem: Bagging-, boosting-, and hybrid-based approaches10.1109/TSMCC.2011.2161285 ↗
11. SMOTE for learning from imbalanced data: Progress and challenges, marking the 15-year anniversary10.1613/jair.1.11192 ↗
12. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
13. Bagging predictors10.1007/BF00058655 ↗
14. A decision-theoretic generalization of on-line learning and an application to boosting10.1006/jcss.1997.1504 ↗
15. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
16. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
18. Learning from imbalanced data: A review and experimental study
19. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
20. Das, M.N., and Giri, N.C. (1979). Design and Analysis of Experiments, New Age International.
21. Design of experiments and response surface methodology to tune machine learning hyperparameters, with a random forest case-study10.1016/j.eswa.2018.05.024 ↗
22. Garofalo, S., Giovagnoli, S., Orsoni, M., Starita, F., and Benassi, M. (2022). Interaction effect: Are you doing the right thing?. PLoS ONE, 17.10.1371/journal.pone.0271668 ↗
23. Special issue on learning from imbalanced data sets10.1145/1007730.1007733 ↗
24. MI-MOTE: Multiple imputation-based minority oversampling technique for imbalanced and incomplete data classification10.1016/j.ins.2021.06.043 ↗
25. Local distribution-based adaptive minority oversampling for imbalanced data classification10.1016/j.neucom.2020.05.030 ↗
26. Seliya, N., Khoshgoftaar, T.M., and Van Hulse, J. (2009, January 2–4). A study on the relationships of classifier performance metrics. Proceedings of the 2009 21st IEEE International Conference on Tools with Artificial Intelligence, Newark, NJ, USA.10.1109/ICTAI.2009.25 ↗
27. kNN approach to unbalanced data distributions: A case study involving information extraction
28. Learning from imbalanced data: Open challenges and future directions10.1007/s13748-016-0094-0 ↗
29. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China.
30. Huang, C., Li, Y., Loy, C.C., and Tang, X. (2016, January 27–30). Learning deep representation for imbalanced classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.580 ↗
31. Boosted classification trees and class probability/quantile estimation
32. Increasing Minority Recall Support Vector Machine Model for Imbalanced Data Classification10.1155/2021/6647557 ↗
33. Random forests10.1023/A:1010933404324 ↗
34. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
35. Ensemble learning method based on CNN for class imbalanced data10.1007/s11227-023-05820-0 ↗
36. Zhou, B., Cui, Q., Wei, X.S., and Chen, Z.M. (2020, January 13–19). Bbn: Bilateral-branch network with cumulative learning for long-tailed visual recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00974 ↗
37. Ilham, A., Silva, J., Mercado-Caruso, N., Tapias-Ruiz, D., and Lezama, O.B.P. (2020, January 6–7). Impact of class imbalance on convolutional neural network training in multi-class problems. Proceedings of the Image Processing and Capsule Networks: ICIPCN 2020, Bangkok, Thailand.10.1007/978-3-030-51859-2_28 ↗
38. Parameter distribution balanced CNNs10.1109/TNNLS.2019.2956390 ↗
39. Yoo, J.H., Yoon, H.i., Kim, H.G., Yoon, H.S., and Han, S.S. (2019, January 25). Optimization of hyper-parameter for CNN model using genetic algorithm. Proceedings of the 2019 1st International Conference on Electrical, Control and Instrumentation Engineering (ICECIE), Kuala Lumpur, Malaysia.10.1109/ICECIE47765.2019.8974762 ↗
40. Solving the class imbalance problem using a counterfactual method for data augmentation
41. A Novel Framework Based on Deep Learning and ANOVA Feature Selection Method for Diagnosis of COVID-19 Cases from Chest X-Ray Images10.1155/2022/4694567 ↗