journal article·2022Open access

MCBC-SMOTE: A Majority Clustering Model for Classification of營mbalanced Data

Jyoti Arora, Meena Tushir, Keshav Sharma, Lalit Mohan, Aman Singh, Abdullah Alharbi, Wael Alosaimi

Computers, Materials & Continua· Volume 73· Issue 3

Abstract

Datasets with the imbalanced class distribution are difficult to handle with the standard classification algorithms. In supervised learning, dealing with the problem of class imbalance is still considered to be a challenging research problem. Various machine learning techniques are designed to operate on balanced datasets; therefore, the state of the art, different under-sampling, over-sampling and hybrid strategies have been proposed to deal with the problem of imbalanced datasets, but highly skewed datasets still pose the problem of generalization and noise generation during resampling. To over-come these problems, this paper proposes a majority clustering model for classification of imbalanced datasets known as MCBC-SMOTE (Majority Clustering for balanced Classification-SMOTE). The model provides a method to convert the problem of binary classification into a multi-class problem. In the proposed algorithm, the number of clusters for the majority class is calculated using the elbow method and the minority class is over-sampled as an average of clustered majority classes to generate a symmetrical class distribution. The proposed technique is cost-effective, reduces the problem of noise generation and successfully disables the imbalances present in between and within classes. The results of the evaluations on diverse real datasets proved to provide better classification results as compared to state of the art existing methodologies based on several performance metrics.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Imbalanced Data Classification Techniques · Anomaly Detection Techniques and Applications · Artificial Intelligence in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (37)

Show source-provided references
1. Editorial: Special issue learning imbalanced datasets10.1145/1007730.1007733 ↗
2. Combating imbalance in network intrusion datasets
3. Mine classification with imbalanced data10.1109/LGRS.2009.2021964 ↗
4. Handling imbalanced datasets: A review
5. Unbalanced breast cancer data classification using novel fitness functions in genetic programming10.1016/j.eswa.2019.112866 ↗
6. A comprehensive data level analysis for cancer diagnosis on imbalanced data10.1016/j.jbi.2018.12.003 ↗
7. Learning when training data are costly: The effect of class distribution on tree induction10.1613/jair.1199 ↗
8. Class-Boundary alignment for imbalanced dataset learning
9. A review on ensembles for the class imbalance problem: Bagging-, boostong-and hybrid-based approaches10.1109/TSMCC.2011.2161285 ↗
10. SMOTE: Synthetic minority oversampling technique10.1613/jair.953 ↗
11. Mixture of expert agents for handling imbalanced datasets
12. Addressing the curse of imbalance training sets: One sided selection
13. Oversampling method for imbalanced classification
14. Cieslak · Machine Learning and Knowledge Discovery in Databases. ECML PKDD · 2008 · 241
15. The class imbalance problem: A systematic study10.3233/IDA-2002-6504 ↗
16. Mwmote-majority weighted minority oversampling technique for imbalanced data set learning10.1109/TKDE.2012.232 ↗
17. FF-SMOTE: A metaheuristic approach to combat class imbalance in binary classification10.1080/08839514.2019.1577017 ↗
18. A method for resampling imbalanced datasets for binary classification tasks for real world problems10.1016/j.neucom.2013.05.059 ↗
19. A hybrid evolutionary preprocessing method for imbalanced datasets10.1016/j.ins.2018.04.068 ↗
20. Effective detection of sophisticated online banking fraud on extremely imbalanced data
21. Big data fraud detection using multiple medicare data sources10.1186/s40537-018-0138-3 ↗
22. Machine learning from imbalanced data sets 101
23. Prati · Advances in Artificial Intelligence–SBIA. Lecture Notes in Computer Science · 2004
24. Bunkhumpornpat · Advances in Knowledge Discovery and Data Mining. PAKDD 2009 · 2009 · 47510.1007/978-3-642-01307-2_43 ↗
25. Robust hybrid data-level sampling approach to handle imbalanced data during classification10.1007/s00500-020-04901-z ↗
26. GT2FS-SMOTE: An intelligent oversampling approach based upon general type-2 fuzzy sets to detect web spam
27. Borderline-smote: A new over-sampling method in imbalanced data sets learning
28. A new cluster-based oversampling method for improving survival prediction of hepatocellular carcinoma patients10.1016/j.jbi.2015.09.012 ↗
29. Cure-smote algorithm and hybrid algorithm for feature selection and parameter optimization, based on random forests10.1186/s12859-017-1578-z ↗
30. Oversampling for imbalanced learning based on k-means and smote10.1016/j.ins.2018.06.056 ↗
31. Wns_inno dataset. [Online]. Available: https://www.kaggle.com/rednivrug/wns-inno. 2018.
32. Credit card fraud detection dataset. [Online]. Available: https://www.kaggle.com/mlg-ulb/creditcardfraud. 2018.
33. Financial distress prediction dataset. [Online]. Available: https://www.kaggle.com/shebrahimi/financial-distress. 2018.
34. Assessment metrics for imbalanced learning10.1002/9781118646106.ch8 ↗
35. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
36. Guo · On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE. OTM 2003. Lecture Notes in Computer Science (LNCS 2888) · 2003 · 986
37. XGBOOST: A scalable tree boosting system