journal article·2022-10-10Open access

A Multi-Classification Method Based on Optimized Binary Tree Mahalanobis-Taguchi System for Imbalanced Data

Yefang Sun, Jun Gong, Yueyi Zhang

Applied Sciences· Volume 12· Issue 19

Abstract

Data imbalance is a common problem in classification tasks. The Mahalanobis-Taguchi system (MTS) has proven to be promising due to its lack of requirements for data distribution. The MTS is a binary classifier. However, multi-classification problems are more common in real life and the diversity of categories may further aggravate the difficulty of classifying imbalanced data. Imbalanced multi-classification has become an important research topic. To improve the performance of MTS in imbalanced multi-classification, we propose an algorithm called optimized binary tree MTS (Optimized BT-MTS). Mahalanobis space (MS) construction, feature selection, and threshold determination are incorporated in a unified classification framework, and joint optimization is carried out according to the principles of maximizing separability, signal-to-noise ratio, dimensionality reduction, and minimizing misclassification cost. Experimental results on several datasets show that the method can significantly reduce the overall misclassification cost and improve the performance of imbalanced data multi-classification.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Optimal Experimental Design Methods · Spectroscopy and Chemometric Analyses

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Economics and Management, China Jiliang University, Hangzhou 310018, China

Funding

National Social Science Foundation of China

References (38)

Show source-provided references
1. Gradient descent evolved imbalanced data gravitation classification with an application on Internet video traffic identification10.1016/j.ins.2020.05.141 ↗
2. A heterogeneous ensemble credit scoring model based on adaptive classifier selection: An application on imbalanced data10.1002/ijfe.2019 ↗
3. Breast Cancer Diagnosis Using Cluster-based Undersampling and Boosted C5.0 Algorithm10.1007/s12555-019-1061-x ↗
4. A Classification Method Based on Feature Selection for Imbalanced Data10.1109/ACCESS.2019.2923846 ↗
5. A hybrid sampling algorithm combining M-SMOTE and ENN based on Random forest for medical imbalanced data10.1016/j.jbi.2020.103465 ↗
6. A CS-AdaBoost-BP model for product quality inspection10.1007/s10479-020-03798-z ↗
7. Advanced Ensemble Adversarial Example on Unknown Deep Neural Network Classifiers10.1587/transinf.2018EDP7073 ↗
8. Detecting Backdoor Attacks via Class Difference in Deep Neural Networks10.1109/ACCESS.2020.3032411 ↗
9. Online ensemble learning algorithm for imbalanced data stream10.1016/j.asoc.2021.107378 ↗
10. Relevant information undersampling to support imbalanced data classification10.1016/j.neucom.2021.01.033 ↗
11. Guo, S., Wei, M., Wang, S., Chen, R., Guo, C., Li, H., and Li, T. (2019). Identify High-Impact Bug Reports by Combining the Data Reduction and Imbalanced Learning Strategies. Appl. Sci., 9.10.3390/app9183663 ↗
12. Joint feature extraction and classification in a unified framework for cost-sensitive face recognition10.1016/j.patcog.2021.107927 ↗
13. A theoretical survey on Mahalanobis-Taguchi system10.1016/j.measurement.2018.12.090 ↗
14. Data Mining Techniques for Assisting the Diagnosis of Pressure Ulcer Development in Surgical Patients10.1007/s10916-011-9706-1 ↗
15. Kim, S.-G., Park, D., and Jung, J.-Y. (2021). Evaluation of One-Class Classifiers for Fault Detection: Mahalanobis Classifiers and the Mahalanobis–Taguchi System. Processes, 9.10.3390/pr9081450 ↗
16. A Review and Analysis of the Mahalanobis—Taguchi System10.1198/004017002188618626 ↗
17. Modified Mahalanobis Taguchi System for Imbalance Data Classification
18. Recognition method of equipment state with the FLDA based Mahalanobis–Taguchi system10.1007/s10479-019-03220-3 ↗
19. Integrating MTS with bagging strategy for class imbalance problems10.1007/s13042-019-01033-1 ↗
20. Classification algorithm for class imbalanced data based on optimized Mahalanobis-Taguchi system10.1007/s10489-021-02929-8 ↗
21. Peng, Z., Cheng, L., and Yao, Q. (2019, January 3–5). Multi-feature Extraction for Bearing Fault Diagnosis Using Binary-tree Mahalanobis-Taguchi System. Proceedings of the 31st Chinese Control and Decision Conference (CCDC), Nanchang, China.10.1109/CCDC.2019.8832374 ↗
22. Peng, C.-F., Ho, L.-H., Tsai, S.-B., Hsiao, Y.-C., Zhai, Y., Chen, Q., Chang, L.-C., and Shang, Z. (2017). Applying the Mahalanobis–Taguchi System to Improve Tablet PC Production Processes. Sustainability, 9.10.3390/su9091557 ↗
23. Mahalanobis classification system (MCS) integrated with binary particle swarm optimization for robust quality classification of complex metallic turbine blades10.1016/j.ymssp.2020.107060 ↗
24. Asakura, T., Yashima, W., Suzuki, K., and Shimotou, M. (2020). Anomaly Detection in a Logistic Operating System Using the Mahalanobis–Taguchi Method. Appl. Sci., 10.10.3390/app10124376 ↗
25. Huh, D.-A., Lim, H.L., Sohn, J.-R., Byeon, S.-H., Jung, S., Lee, W.-K., and Moon, K.W. (2018). Development of a Screening Method for Health Hazard Ranking and Scoring of Chemicals Using the Mahalanobis–Taguchi System. Int. J. Environ. Res. Public Health, 15.10.3390/ijerph15102208 ↗
26. Ramlie, F., Muhamad, W., Harudin, N., Abu, M., Yahaya, H., Jamaludin, K., and Talib, H.A. (2021). Classification Performance of Thresholding Methods in the Mahalanobis–Taguchi System. Appl. Sci., 11.10.3390/app11093906 ↗
27. An Evaluation of the Robustness of MTS for Imbalanced Data10.1109/TKDE.2007.190623 ↗
28. Cost-sensitive Dictionary Learning for Software Defect Prediction10.1007/s11063-020-10355-z ↗
29. Integrating TANBN with cost sensitive classification algorithm for imbalanced data in medical diagnosis10.1016/j.cie.2019.106266 ↗
30. Instance-dependent cost-sensitive learning for detecting transfer fraud10.1016/j.ejor.2021.05.028 ↗
31. Cost-sensitive design of error correcting output codes10.1177/0954406217709303 ↗
32. Quantum-behaved RS-PSO-LSSVM method for quality prediction in parts production processes10.1002/cpe.5522 ↗
33. Particle swarm optimisation in designing parameters of manufacturing processes: A review (2008–2018)10.1016/j.asoc.2019.105743 ↗
34. An effective and distributed particle swarm optimization algorithm for flexible job-shop scheduling problem10.1007/s10845-015-1039-3 ↗
35. Binary Tree Support Vector Machine Based on Number of Inter-Class Similarity Direction
36. Classification using improved Mahanobis-Taguchi system based on omni-optimizer
37. Random subspace oracle (RSO) ensemble to solve small sample-sized classification problems10.3233/JIFS-18504 ↗
38. BlindNet backdoor: Attack on deep neural network using blind watermark10.1007/s11042-021-11135-0 ↗