journal article·2024Open access

Learning Vector Quantization-Based Fuzzy Rules Oversampling Method

Jiqiang Chen, Ranran Han, Dongqing Zhang, Litao Ma

Computers, Materials & Continua· Volume 79· Issue 3

Abstract

Imbalanced datasets are common in practical applications, and oversampling methods using fuzzy rules have been shown to enhance the classification performance of imbalanced data by taking into account the relationship between data attributes. However, the creation of fuzzy rules typically depends on expert knowledge, which may not fully leverage the label information in training data and may be subjective. To address this issue, a novel fuzzy rule oversampling approach is developed based on the learning vector quantization (LVQ) algorithm. In this method, the label information of the training data is utilized to determine the antecedent part of If-Then fuzzy rules by dynamically dividing attribute intervals using LVQ. Subsequently, fuzzy rules are generated and adjusted to calculate rule weights. The number of new samples to be synthesized for each rule is then computed, and samples from the minority class are synthesized based on the newly generated fuzzy rules. This results in the establishment of a fuzzy rule oversampling method based on LVQ. To evaluate the effectiveness of this method, comparative experiments are conducted on 12 publicly available imbalance datasets with five other sampling techniques in combination with the support function machine. The experimental results demonstrate that the proposed method can significantly enhance the classification algorithm across seven performance indicators, including a boost of 2.15% to 12.34% in Accuracy, 6.11% to 27.06% in G-mean, and 4.69% to 18.78% in AUC. These show that the proposed method is capable of more efficiently improving the classification performance of imbalanced data.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Imbalanced Data Classification Techniques · Face and Expression Recognition · Fuzzy Logic and Control Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (24)

Show source-provided references
1. Fuzzy information decomposition incorporated and weighted relief-f feature selection: When imbalanced data meet incompletion10.1016/j.ins.2021.10.057 ↗
2. Fault detection and classification of the rotor unbalance based on dynamics features and support vector machine10.1177/00202940221135917 ↗
3. An adaptive loss backward feature elimination method for class-imbalanced and mixed-type data in medical diagnosis10.1016/j.chemolab.2023.104809 ↗
4. Imbalanced text sentiment classification based on multi-channel BLTCN-BLSTM self-attention10.3390/s23042257 ↗
5. Penalized least squares classifier: Classification by regression via iterative cost-sensitive learning10.1007/s11063-023-11178-4 ↗
6. Comparative study of combination of preprocessing, n-gram feature extraction, feature selection, and classification method in Indonesian sentiment analysis with imbalanced data
7. Imputation-based ensemble techniques for class imbalance learning
8. Enhancing sentiment analysis via random majority under-sampling with reduced time complexity for classifying tweet reviews10.3390/electronics11213624 ↗
9. A comparison of undersampling, oversampling, and smote methods for dealing with imbalanced classification in educational data mining10.3390/info14010054 ↗
10. Fuzzy rule-based oversampling technique for imbalanced and incomplete data learning10.1016/j.knosys.2018.05.044 ↗
11. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
12. The imbalanced training sample problem: Under or over sampling?
13. Fast-CBUS: A fast clustering-based undersampling method for addressing the class imbalance problem10.1016/j.neucom.2017.03.011 ↗
14. SMOTE: Synthetic minority oversampling technique10.1613/jair.953 ↗
15. Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning
16. ADASYN: Adaptive synthetic sampling approach for imbalanced learning
17. MWMOTE-majority weighted minority oversampling technique for imbalanced data set learning10.1109/TKDE.2012.232 ↗
18. Power distribution fault cause identification with imbalanced data using the data mining-based fuzzy classification $E$-algorithm10.1109/TPWRS.2006.888990 ↗
19. A proposal for evolutionary fuzzy systems using feature weighting: Dealing with overlapping in imbalanced datasets10.1016/j.knosys.2014.09.002 ↗
20. A study of the behavior of linguistic fuzzy rule based classification systems in the framework of imbalanced data-sets10.1016/j.fss.2007.12.023 ↗
21. Fuzzy-based information decomposition for incomplete and imbalanced data learning10.1109/TFUZZ.2017.2754998 ↗
22. An LVQ clustering algorithm based on neighborhood granules10.3233/JIFS-220092 ↗
23. Support function machine for set-based classification with application to water quality evaluation10.1016/j.ins.2017.01.001 ↗
24. Statistical comparisons of classifiers over multiple data sets