journal article·2022Open access

Incremental Learning Framework for Mining Big Data Stream

Alaa Eisa, Nora EL-Rashidy, Mohammad Dahman Alshehri, Hazem M. El-bakry, Samir Abdelrazek

Computers, Materials & Continua· Volume 71· Issue 2

Abstract

At this current time, data stream classification plays a key role in big data analytics due to its enormous growth. Most of the existing classification methods used ensemble learning, which is trustworthy but these methods are not effective to face the issues of learning from imbalanced big data, it also supposes that all data are pre-classified. Another weakness of current methods is that it takes a long evaluation time when the target data stream contains a high number of features. The main objective of this research is to develop a new method for incremental learning based on the proposed ant lion fuzzy-generative adversarial network model. The proposed model is implemented in spark architecture. For each data stream, the class output is computed at slave nodes by training a generative adversarial network with the back propagation error based on fuzzy bound computation. This method overcomes the limitations of existing methods as it can classify data streams that are slightly or completely unlabeled data and providing high scalability and efficiency. The results show that the proposed model outperforms state-of-the-art performance in terms of accuracy (0.861) precision (0.9328) and minimal MSE (0.0416).
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Data Stream Mining Techniques · Machine Learning and ELM · Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (66)

Show source-provided references
1. A centralized trust management mechanism for the internet of things
2. Ubiquitous smart learning system for smart cities
3. Broad learning system: An effective and efficient incremental learning system without the need for deep architecture10.1109/TNNLS.2017.2716952 ↗
4. Dataspeak: data extraction, aggregation, and classification using big data novel algorithm
5. A non-canonical hybrid metaheuristic approach to adaptive data stream classification10.1016/j.future.2019.07.067 ↗
6. Alshehri · Recent Trends and Advances in Wireless and IoT-Enabled Networks · 2019
7. Learn#: A novel incremental learning method for text classification10.1016/j.eswa.2020.113198 ↗
8. Fuzzy clustering algorithm for time series based on adaptive incremental learning10.3233/JIFS-179624 ↗
9. Optimized deep belief network and entropy-based hybrid bounding model for incremental text categorization10.1108/IJWIS-03-2020-0015 ↗
10. Data stream classification by dynamic incremental semi-supervised fuzzy clustering10.1142/S0218213019600091 ↗
11. Clustering-driven intelligent trust management methodology for the internet of things (CITM-IoT)10.1007/s11036-018-1017-z ↗
12. Collaborative virtual environment model for medical e-learning
13. Mobile health in remote patient monitoring for chronic diseases: Principles, trends and challenges10.3390/diagnostics11040607 ↗
14. Choosing the best algorithm for an incremental on-line learning task
15. On the use of an incremental approach to learn fuzzy classification rules for big data problems
16. Incremental learning: Areas and methods – a survey10.5121/ijdkp.2012.2504 ↗
17. Incremental on-line learning: A review and comparison of state of the art algorithms10.1016/j.neucom.2017.06.084 ↗
18. Comparative study between incremental and ensemble learning on data streams: Case study10.1186/2196-1115-1-5 ↗
19. Intensive care unit mortality prediction: An improved patient-specific stacking ensemble model10.1109/ACCESS.2020.3010556 ↗
20. Incremental neural-network learning for big fraud data
21. Analyzing mental health diseases in a spanish region using software based on graph theory algorithms
22. Ensemble diagnosis method based on transfer learning and incremental learning towards mechanical big data10.1016/j.measurement.2020.107517 ↗
23. End-to-end deep learning framework for coronavirus (COVID-19) detection and monitoring10.3390/electronics9091439 ↗
24. Dynamic extreme learning machine for data stream classification10.1016/j.neucom.2016.12.078 ↗
25. Incremental learning imbalanced data streams with concept drift: The dynamic updated ensemble algorithm10.1016/j.knosys.2020.105694 ↗
26. Machine learning algorithms for big data analytics
27. A review on incremental machine learning methods, applications and open challenges
28. Clustering versus incremental learning multi-codebook fuzzy neural network for multi-modal data classification
29. Ensemble OS-eLM based on combination weight for data stream classification10.1007/s10489-018-01403-2 ↗
30. Applying cloud based machine learning on biosensors streaming data for health status prediction
31. An effective model for handling the big data streams based on the optimization-enabled spark framework
32. Distributed incremental clustering algorithms: A bibliometric and word-cloud review analysis10.1080/0194262X.2020.1775163 ↗
33. An integrated classification model for incremental learning10.1007/s11042-020-10070-w ↗
34. An adaptive algorithm for dealing with data stream evolution and singularity10.1016/j.ins.2020.07.010 ↗
35. A fuzzy security protocol for trust management in the internet of things (Fuzzy-IoT)10.1007/s00607-018-0685-7 ↗
36. Big data analytics in heart diseases prediction
37. Evaluating learners progress in smart learning environment
38. Incremental learning algorithms and applications
39. A parallel and incremental approach for data-intensive learning of Bayesian networks10.1109/TCYB.2015.2388791 ↗
40. Adaptive random forests for evolving data stream classification10.1007/s10994-017-5642-8 ↗
41. Big data classification using scale-free binary particle swarm optimization
42. Asynchronous dual-pipeline deep learning framework for online data stream classification10.3233/ICA-200617 ↗
43. BigDL: A distributed deep learning framework for big data
44. Bagging using instance-level difficulty for multi-class imbalanced big data classification on spark
45. A review on big data with data mining
46. A comparative analysis of scalable and context-aware trust management approaches for internet of things
47. Development of smart healthcare system for visually impaired using speech recognition smart healthcare system10.14569/IJACSA.2020.0111275 ↗
48. Elkhodr · Applications of Intelligent Technologies in Healthcare · 2019
49. Development of smart healthcare system based on speech recognition using support vector machine and dynamic time warping10.3390/su12062403 ↗
50. Empirical analysis of classification algorithms in data stream mining
51. Comprehensive survey of using machine learning in the COVID-19 pandemic10.3390/diagnostics11071155 ↗
52. Review of online and soft computing maximum power point tracking techniques under non-uniform solar irradiation conditions10.3390/en13123256 ↗
53. Systematic literature review of sentiment analysis on twitter using soft computing techniques10.1002/cpe.5107 ↗
54. Soft computing-based method for estimation of almond kernel mass from its shell features10.1016/j.scienta.2019.109071 ↗
55. A comprehensive review and analysis of supervised-learning and soft computing techniques for stress diagnosis in humans10.1016/j.compbiomed.2021.104450 ↗
56. A comprehensive analysis of nature-inspired meta-heuristic techniques for feature selection problem10.1007/s11831-020-09412-6 ↗
57. LFNN: Lion fuzzy neural network-based evolutionary model for text classification using context and sense based features10.1016/j.asoc.2018.07.016 ↗
58. Data provenance in the internet of things
59. A novel chaotic interior search algorithm for global optimization and feature selection10.1080/08839514.2020.1712788 ↗
60. Imbalanced fault diagnosis of rolling bearing based on generative adversarial network: A comparative study10.1109/ACCESS.2018.2890693 ↗
61. The ant lion optimizer10.1016/j.advengsoft.2015.01.010 ↗
62. Ant lion optimization: Variants, hybrids, and applications10.1109/ACCESS.2020.2990338 ↗
63. Using cost-sensitive learning and feature selection algorithms to improve the performance of imbalanced classification10.1109/ACCESS.2020.2987364 ↗
64. “WebKB dataset.” 2017. https://github.com/starling-lab/boostsrl/wiki/webkb-dataset.
65. “20 Newsgroups.” 1998. http://qwone.com/~jason/20newsgroups/.
66. “Reuters-21578 text categorization collection data set.” 1997. http://archive.ics.uci.edu/ml/datasets/reuters-21578+text+categorization+collection.