Hybrid Sampling and Dynamic Weighting-Based Classification Method for Multi-Class Imbalanced Data Stream
Source abstract
Abstract
The imbalance and concept drift problems in data streams become more complex in multi-class environment, and extreme imbalance and variation in class ratio may also exist. To tackle the above problems, Hybrid Sampling and Dynamic Weighted-based classification method for Multi-class Imbalanced data stream (HSDW-MI) is proposed. The HSDW-MI algorithm deals with imbalance and concept drift problems through the hybrid sampling and dynamic weighting phases, respectively. In the hybrid sampling phase, adaptive spectral clustering is proposed to sample the data after clustering, which can maintain the original data distribution; then the sample safety factor is used to determine the samples to be sampled for each class; the safe samples are oversampled and the unsafe samples are under-sampled in each cluster. If the data stream is extremely imbalanced, the sample storage pool is used to extract samples with a high safety factor to add to the data stream. In the dynamic weighting phase, a dynamic weighting method based on the G-mean value is proposed. The G-mean values are used as the weights of each base classifier in the ensemble and the ensemble is dynamically updated during the processing of the data stream to accommodate the occurrence of concept drift. Experiments were conducted with LB, OAUE, ARF, BOLE, MUOB, MOOD, CALMID, and the proposed HSDW-MI on 10 multi-class synthetic data streams with different class ratios and concept drifts and 3 real multi-class imbalanced streams with unknown drifts, and the results show that the proposed HSDW-MI has better classification capabilities and performs more consistently compared to all other algorithms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Stream Mining Techniques · Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Engineering, North Minzu University, Yinchuan 750021, China
Funding
National Nature Science Foundation of China · Ningxia Natural Science Foundation Project · Graduate Innovation Project of North Minzu University
References (33)
Show source-provided references
1. Handling imbalanced data with concept drift by applying dynamic sampling and ensemble classification model10.1016/j.comcom.2020.01.061 ↗
2. Wang, S., Minku, L.L., and Yao, X. (2016, January 9–15). Dealing with Multiple Classes in Online Class Imbalance Learning. Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, NY, USA.
3. Evaluation of Supervised Machine Learning Algorithms for Multi-Class Intrusion Detection Systems
4. Review of Machine Learning Approach on Credit Card Fraud Detection10.1007/s44230-022-00004-0 ↗
5. Ahsan, M.M., Luna, S.A., and Siddique, Z. (2022). Machine-learning-based disease diagnosis: A comprehensive review. Healthcare, 10.10.3390/healthcare10030541 ↗
6. Learning under concept drift: A review
7. An overview of complex data stream ensemble classification10.3233/JIFS-211100 ↗
8. Meta-cognitive online sequential extreme learning machine for imbalanced and concept-drifting data classification10.1016/j.neunet.2016.04.008 ↗
9. Ferreira, L.E.B., Gomes, H.M., Bifet, A., and Oliveira, L.S. (2019, January 14–19). Adaptive random forests with resampling for imbalanced data streams. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.
10. To combat multi-class imbalanced problems by means of over-sampling techniques10.1109/TKDE.2015.2458858 ↗
11. Synthetic minority oversampling technique for multiclass imbalance problems10.1016/j.patcog.2017.07.024 ↗
12. Arafat, M.Y., Hoque, S., and Farid, D.M. (2017, January 6–8). Cluster-based under-sampling with random forest for multi-class imbalanced classification. Proceedings of the 11th International Conference on Software, Knowledge, Information Management and Applications (SKIMA), Malabe, Sri Lanka.10.1109/SKIMA.2017.8294105 ↗
13. Random balance: Ensembles of variable priors classifiers for imbalanced data10.1016/j.knosys.2015.04.022 ↗
14. Random balance ensembles for multiclass imbalance learning10.1016/j.knosys.2019.105434 ↗
15. HAR-MI method for multi-class imbalanced datasets
16. Improved resampling algorithm through a modified oversampling approach based on spectral clustering and SMOTE10.1007/s00542-022-05287-8 ↗
17. Sainin, M.S., Alfred, R., Adnan, F., and Ahmad, F. (2021, January 28–29). Combining sampling and ensemble classifier for multiclass imbalance data learning. Proceedings of the International Conference on Computational Science and Technology, Labuan, Malaysia.
18. Vafaie, P., Viktor, H., and Michalowski, W. (2020, January 17–20). Multi-class imbalanced semi-supervised learning from streams through online ensembles. Proceedings of the International Conference on Data Mining Workshops, Sorrento, Italy.10.1109/ICDMW51313.2020.00124 ↗
19. Weighted Ensemble with one-class Classification and Over-sampling and Instance selection (WECOI): An approach for learning from imbalanced data streams10.1016/j.jocs.2022.101614 ↗
20. Dynamic ensemble selection classification algorithm based on window over imbalanced drift data stream10.1007/s10115-022-01791-5 ↗
21. Bifet, A., Holmes, G., and Pfahringer, B. (2010). Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2010, Barcelona, Spain, 20–24 September 2010, Proceedings, Part I 21, Springer.
22. Bifet, A., and Gavalda, R. (2007, January 26–28). Learning from time-changing data with adaptive windowing. Proceedings of the 7th SIAM International Conference on Data Mining, Minneapolis, MN, USA.10.1137/1.9781611972771.42 ↗
23. Adaptive random forests for evolving data stream classification10.1007/s10994-017-5642-8 ↗
24. A comprehensive active learning method for multiclass imbalanced data streams with concept drift10.1016/j.knosys.2021.106778 ↗
25. De Barros, R.S.M., de Carvalho Santos, S.G.T., and Júnior, P.M.G. (2016, January 24–29). A boosting-like online learning ensemble. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.10.1109/IJCNN.2016.7727427 ↗
26. An overview on concept drift learning10.1109/ACCESS.2018.2886026 ↗
27. A survey of active and passive concept drift handling methods10.1111/coin.12520 ↗
28. Combining chunk-based and online methods in learning ensembles from concept drifting data streams10.1016/j.ins.2013.12.011 ↗
29. A clustering-based approach to land valuation in land consolidation projects10.1016/j.landusepol.2021.105739 ↗
30. Using information on class interrelations to improve classification of multiclass imbalanced data: A new resampling algorithm10.2478/amcs-2019-0057 ↗
31. Multi-class and feature selection extensions of roughly balanced bagging for imbalanced data10.1007/s10844-017-0446-7 ↗
32. A class imbalance-aware review rating prediction using hybrid sampling and ensemble learning10.1007/s11042-020-10024-2 ↗
33. Bifet, A., Holmes, G., Pfahringer, B., Kranen, P., Kremer, H., Jansen, T., and Seidl, T. (2010, January 1–3). Moa: Massive online analysis, a framework for stream classification and clustering. Proceedings of the First Workshop on Applications of Pattern Analysis, Windsor, UK.