journal article·2022-09-09Open access

Process-Oriented Stream Classification Pipeline: A Literature Review

Lena Clever, Janina Susanne Pohl, Jakob Bossek, Pascal Kerschke, Heike Trautmann

Applied Sciences· Volume 12· Issue 18

Abstract

Due to the rise of continuous data-generating applications, analyzing data streams has gained increasing attention over the past decades. A core research area in stream data is stream classification, which categorizes or detects data points within an evolving stream of observations. Areas of stream classification are diverse—ranging, e.g., from monitoring sensor data to analyzing a wide range of (social) media applications. Research in stream classification is related to developing methods that adapt to the changing and potentially volatile data stream. It focuses on individual aspects of the stream classification pipeline, e.g., designing suitable algorithm architectures, an efficient train and test procedure, or detecting so-called concept drifts. As a result of the many different research questions and strands, the field is challenging to grasp, especially for beginners. This survey explores, summarizes, and categorizes work within the domain of stream classification and identifies core research threads over the past few years. It is structured based on the stream classification process to facilitate coordination within this complex topic, including common application scenarios and benchmarking data sets. Thus, both newcomers to the field and experts who want to widen their scope can gain (additional) insight into this research area and find starting points and pointers to more in-depth literature on specific issues and research directions in the field.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Data Stream Mining Techniques · Anomaly Detection Techniques and Applications · Network Security and Intrusion Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Systems, University of Münster, 48149 Münster, Germany

Department of Computer Science, RWTH Aachen University, 52062 Aachen, Germany

“Friedrich List” Faculty of Transport and Traffic Sciences, TU Dresden, 01062 Dresden, Germany

Data Management & Biometrics Group, University of Twente, 7522 NB Enschede, The Netherlands

Funding

Project DemoResil · German ministry of culture and science and the BMBF-funded project Hybrid · European Research Center for Information Systems (ERCIS), and the Topical Program “Algorithmization and Social Interaction” of the University of Münster · Topical Program “Algorithmization and Social Interaction” of the University of Münster

References (100+)

Show source-provided references
1. Stefanowski, J., and Brzezinski, D. (2017). Stream Classification. Encyclopedia of Machine Learning and Data Mining, Springer.10.1007/978-1-4899-7687-1_908 ↗
2. Fall Detection Based on Posture Classification for Smart Home Environment10.1007/s12652-019-01600-y ↗
3. Streaming Classification of Variable Stars10.1093/mnras/stz3426 ↗
4. A Survey on Concept Drift Adaptation10.1145/2523813 ↗
5. A Survey on Ensemble Learning for Data Stream Classification
6. Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer.
7. Data Stream Classification with Novel Class Detection: A Review, Comparison and Challenges10.1007/s10115-021-01582-4 ↗
8. Deep Learning for IoT Big Data and Streaming Analytics: A Survey10.1109/COMST.2018.2844341 ↗
9. Event Driven and Semantic Based Approach for Data Processing on IoT Gateway Devices10.1007/s12652-018-0843-y ↗
10. Jin, J., Li, P., and Fan, L. (2019, January 4). A Framework for Classification of Data Stream Application in Vehicular Network Computing. Proceedings of the Green Energy and Networking, Dalian, China.
11. Grzenda, M., Kwasiborska, K., and Zaremba, T. (2017, January 6–8). Combining Stream Mining and Neural Networks for Short Term Delay Prediction. Proceedings of the International Joint Conference SOCO’17-CISIS’17-ICEUTE’17, León, Spain.10.1007/978-3-319-67180-2_18 ↗
12. Multi-Label Zero-Shot Human Action Recognition Via Joint Latent Ranking Embedding10.1016/j.neunet.2019.09.029 ↗
13. Khannouz, M., and Glatard, T. (2020). A Benchmark of Data Stream Classification for Human Activity Recognition on Connected Objects. Sensors, 20.10.3390/s20226486 ↗
14. Video Benchmarks of Human Action Datasets: A Review10.1007/s10462-018-9651-1 ↗
15. 3D Sign Language Recognition with Joint Distance and Angular Coded Color Topographical Descriptor on a 2–Stream CNN10.1016/j.neucom.2019.09.059 ↗
16. Video Stream Analysis in Clouds: An Object Detection and Classification Framework for High Performance Video Analytics10.1109/TCC.2016.2517653 ↗
17. Detecting Cyberbullying in Social Networks using Multi-Agent System
18. An Ensemble Heterogeneous Classification Methodology for Discovering Health-Related Knowledge in Social Media Messages10.1016/j.jbi.2014.03.005 ↗
19. A Text Classification Framework for Simple and Effective Early Depression Detection over Social Media Streams10.1016/j.eswa.2019.05.023 ↗
20. Deviatkin, D., Shelmanov, A., and Larionov, D. (2018, January 9–12). Discovering, Classification, and Localization of Emergency Events via Analyzing of Social Network Text Streams. Proceedings of the International Conference on Data Analytics and Management in Data Intensive Domains, Moscow, Russia.10.1007/978-3-030-23584-0_11 ↗
21. Tree-Based Text Stream Clustering with Application to Spam Mail Classification
22. Online Biterm Topic Model Based Short Text Stream Classification Using Short Text Expansion and Concept Drifting Detection10.1016/j.patrec.2018.10.018 ↗
23. Deep Learning for Image Sequence Classification of Astronomical Events10.1088/1538-3873/aaef12 ↗
24. Lyon, R., Brooke, J., Knowles, J., and Stappers, B. (2013, January 13–16). A Study on Classification in Imbalanced and Partially-Labelled Data Streams. Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK.10.1109/SMC.2013.260 ↗
25. Computational Intelligence Challenges and Applications on Large-Scale Astronomical Time Series Databases10.1109/MCI.2014.2326100 ↗
26. An Unexpectedly Large Count of Trees in the West African Sahara and Sahel10.1038/s41586-020-2824-5 ↗
27. Novel Deep Learning Framework for Broadcasting Abnormal Events Obtained From Surveillance Applications
28. Improved Medical Image Classification Accuracy on Heterogeneous and Imbalanced Data using Multiple Streams Network
29. Ding, Y., Li, Z., and Yastremsky, D. (2021). Real-time Face Mask Detection in Video Data. arXiv.
30. Liu, L., Lei, W., Wan, X., Liu, L., Luo, Y., and Feng, C. (2020, January 9–11). Semi-Supervised Active Learning for COVID-19 Lung Ultrasound Multi-symptom Classification. Proceedings of the 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Baltimore, MD, USA.10.1109/ICTAI50040.2020.00191 ↗
31. Class-Imbalanced Dynamic Financial Distress Prediction Based on Adaboost-SVM Ensemble Combined with SMOTE and Time Weighting10.1016/j.inffus.2019.07.006 ↗
32. OpenML: Networked Science in Machine Learning10.1145/2641190.2641198 ↗
33. Literature review and analysis on big data stream classification techniques
34. Challenges in Benchmarking Stream Learning Algorithms with Real-World Data10.1007/s10618-020-00698-5 ↗
35. Machine Learning for Streaming Data: State of the Art, Challenges, and Opportunities10.1145/3373464.3373470 ↗
36. Learning Under Concept Drift: A Review
37. Concept drift in Streaming Data Classification: Algorithms, Platforms and Issues10.1016/j.procs.2017.11.440 ↗
38. Evolutionary model building under streaming data for classification tasks: Opportunities and challenges10.1007/s10710-014-9236-y ↗
39. Blockeel, H., Kersting, K., Nijssen, S., and Železný, F. (2013, January 23–27). Pitfalls in Benchmarking Data Stream Classification and How to Avoid Them. Lecture Notes in Computer Science, Prague, Czech Republic.
40. A Survey on Multi-Label Data Stream Classification10.1109/ACCESS.2019.2962059 ↗
41. A survey on semi-supervised learning10.1007/s10994-019-05855-6 ↗
42. Narasimhamurthy, A., and Kuncheva, L.I. (2007, January 12–14). A Framework for Generating Data to Simulate Changing Environments. Proceedings of the 25th Conference on IASTED International Multi-Conference: Artificial Intelligence and Applications, Innsbruck, Austria.
43. Network traffic classification for data fusion: A survey10.1016/j.inffus.2021.02.009 ↗
44. Intrusion Detection Systems: A Cross-Domain Overview10.1109/COMST.2019.2922584 ↗
45. Veit, A., Matera, T., Neumann, L., Matas, J., and Belongie, S. (2016). COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Images. arXiv.
46. Assenmacher, D., Weber, D., Preuss, M., Calero Valdez, A., Bradshaw, A., Ross, B., Cresci, S., Trautmann, H., Neumann, F., and Grimme, C. (2021). Benchmarking Crisis in Social Media Analytics: A Solution for the Data Sharing Problem. Soc. Sci. Comput. Rev. (SSCR) J., 39.10.1177/08944393211012268 ↗
47. Gama, J., Medas, P., Castillo, G., and Rodrigues, P. Learning with Drift Detection. Proceedings of the Brazilian Symposium on Artificial Intelligence.
48. Aha, D. (2022, September 05). Waveform Database Generator Data Set. Available online: http://archive.ics.uci.edu/ml/datasets/waveform+database+generator+%28version+1%29.
49. Barddal, J.P., Murilo Gomes, H., and Enembreck, F. (2015, January 9–11). A Survey on Feature Drift Adaptation. Proceedings of the 27th International Conference on Tools with Artificial Intelligence, Vietri sul Mare, Italy.10.1109/ICTAI.2015.150 ↗
50. Bifet, A., Gavaldà, R., Holmes, G., and Pfahringer, B. (2018). Machine Learning for Data Streams: With Practical Examples in MOA, The MIT Press.10.7551/mitpress/10654.001.0001 ↗
51. Hulten, G., Spencer, L., and Domingos, P. (2001, January 26–29). Mining Time-Changing Data Streams. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/502512.502529 ↗
52. Street, W.N., and Kim, Y. (2001, January 26–29). A Streaming Ensemble Algorithm (SEA) for Large-Scale Classification. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/502512.502568 ↗
53. Incremental Learning from Noisy Data10.1007/BF00116895 ↗
54. Database Mining: A Performance Perspective10.1109/69.250074 ↗
55. Breiman, L., Friedman, J.H., Olshen, R.A., and Stone, C.J. (1984). Classification and Regression Trees, Brooks/Cole Publishing.
56. Aha, D. (2022, September 05). LED Display Domain Data Set. Available online: https://archive.ics.uci.edu/ml/datasets/LED+Display+Domain.
57. Incremental Learning of Concept Drift in Nonstationary Environments10.1109/TNN.2011.2160459 ↗
58. Kohavi, R. (1996, January 2–4). Scaling up the accuracy of naive-Bayes classifiers: A decision-tree hybrid. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, Portland, OR, USA.
59. Data Expo (2022, September 05). Airline On-Time Performance. Available online: http://stat-computing.org/dataexpo/2009/.
60. Visser, B., and Gouk, H. (2022, September 05). AWS Spot Pricing Market. Available online: https://www.openml.org/d/41424.
61. Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report.
62. CIFAR10-DVS: An event-stream dataset for object classification10.3389/fnins.2017.00309 ↗
63. Harries, M. (1999). SPLICE-2 Comparative Evaluation: Electricity Pricing, University of South Wales. Technical Report.
64. A case-based technique for tracking concept drift in spam filtering10.1016/j.knosys.2004.10.002 ↗
65. Tracking Recurring Contexts Using Ensemble Classifiers: An Application to Email Filtering10.1007/s10115-009-0206-2 ↗
66. Comparative Accuracies of Artificial Neural Networks and Discriminant Analysis in Predicting Forest Cover Types from Cartographic Variables10.1016/S0168-1699(99)00046-0 ↗
67. Chemical gas sensor drift compensation using classifier ensembles10.1016/j.snb.2012.01.074 ↗
68. On the calibration of sensor arrays for pattern recognition using the minimal number of experiments10.1016/j.chemolab.2013.10.012 ↗
69. Zhu, X. (2022, September 05). Stream Data Mining Repository. Available online: https://www.cse.fau.edu/~xqzhu/stream.html.
70. Jha, S., Sommer, R., and Kreibich, C. (2010, January 15–17). Why Did My Detector Do That?!. Proceedings of the Recent Advances in Intrusion Detection, Ottawa, ON, Canada.10.1007/978-3-642-15512-3 ↗
71. Gradient-Based Learning Applied to Document Recognition10.1109/5.726791 ↗
72. Combining Similarity in Time and Space for Training Set Formation Under Concept Drift10.3233/IDA-2011-0484 ↗
73. Incremental Learning of Concept Drift from Streaming Imbalanced Data10.1109/TKDE.2012.136 ↗
74. Zupan, B., Bohanec, M., Bratko, I., and Demsar, J. (1997, January 8–12). Machine Learning by Function Decomposition. Proceedings of the Fourteenth International Conference on Machine Learning; Morgan Kaufmann, Nashville, TN, USA.
75. Forecasting Skewed Biased Stochastic Ozone Days: Analyses, Solutions and Beyond10.1007/s10115-007-0095-1 ↗
76. Losing, V., Hammer, B., and Wersing, H. (2015, January 12–17). Interactive online learning for obstacle classification on a mobile robot. Proceedings of the International Joint Conference on Neural Networks, Killarney, Ireland.10.1109/IJCNN.2015.7280610 ↗
77. Supervised and Unsupervised Data Mining with an Evolutionary Algorithm
78. Losing, V., Hammer, B., and Wersing, H. (2016, January 12–15). KNN Classifier with Self Adjusting Memory for Heterogeneous Concept Drift. Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM), Barcelona, Spain.10.1109/ICDM.2016.0040 ↗
79. Katakis, I., Tsoumakas, G., and Vlahavas, I. (2008, January 21). An Ensemble of Classifiers for coping with Recurring Contexts in Data Streams. Proceedings of the 18th European Conference Artificial Intelligence, European Coordinating Committee for Artificial Intelligence, Patras, Greece.
80. Katakis, I., Tsoumakas, G., and Vlahavas, I. (2006, January 18–22). Dynamic Feature Space and Incremental Feature Selection for the Classification of Textual Data Streams. Proceedings of the ECML/PKDD-2006 International Workshop on Knowledge Discovery from Data Streams, Berlin, Germany.
81. CLeaR: An adaptive continual learning framework for regression tasks10.1186/s42467-021-00009-8 ↗
82. Zliobaite, I. (2013). How good is the Electricity benchmark for evaluating concept drift adaptation. arXiv.
83. Evaluation Methods and Decision Theory for Classification of Streaming Data with Temporal Dependence10.1007/s10994-014-5441-4 ↗
84. Ensemble learning for data stream analysis: A survey10.1016/j.inffus.2017.02.004 ↗
85. Data Stream Mining: Methods and Challenges for Handling Concept Drift10.1007/s42452-019-1433-0 ↗
86. Data stream classification: A review10.1007/s42044-020-00061-3 ↗
87. Gartner IT Glossary (2022, September 05). Frameworks. Available online: https://www.gartner.com/en/information-technology/glossary/framework.
88. Data stream analysis: Foundations, major tasks and tools10.1002/widm.1405 ↗
89. A Survey on Data Stream Clustering and Classification10.1007/s10115-014-0808-1 ↗
90. Inoubli, W., Aridhi, S., Mezni, H., Maddouri, M., and Nguifo, E. (2018, January 27–31). A comparative study on streaming frameworks for big data. Proceedings of the Very Large Data Bases (VLDB), Rio de Janeiro, Brazil.
91. Big data preprocessing: Methods and prospects10.1186/s41044-016-0014-0 ↗
92. Hulten, G., and Domingos, P. (2022, September 05). VFML: Very Fast Machine Learning Toolkit for Mining High-Speed Data Streams. Available online: https://www.cs.washington.edu/dm/vfml/.
93. Jubatus Team (2022, September 05). Framework and Library for Distributed Online Machine Learning. Available online: http://jubat.us/en/.
94. Apache Software Foundation (2022, September 05). Apache Spark–Unified Analytics Engine for Big Data. Available online: https://spark.apache.org.
95. Noah’s Ark Lab (2022, September 05). streamDM: Data Mining for Spark Streaming. Available online: http://huawei-noah.github.io/streamDM/.
96. Montiel, J., Halford, M., Mastelini, S.M., Bolmier, G., Sourty, R., Vaysse, R., Zouitine, A., Gomes, H.M., Read, J., and Abdessalem, T. (2020). River: Machine Learning for Streaming Data in Python. arXiv.
97. Bifet, A., Holmes, G., Pfahringer, B., Kranen, P., Kremer, H., Jansen, T., and Seidl, T. (2010, January 1–3). MOA: Massive Online Analysis. A Framework for Stream Classification and Clustering. Proceedings of the First Workshop on Applications of Pattern Analysis, Windsor, UK.
98. The WEKA Data Mining Software: An Update10.1145/1656274.1656278 ↗
99. A Survey on Data Preprocessing for Data Stream Mining: Current Status and Future Directions10.1016/j.neucom.2017.01.078 ↗
100. Balcázar, J.L., Bonchi, F., Gionis, A., and Sebag, M. (2011, January 5–9). Classification and Novel Class Detection of Data Streams in a Dynamic Feature Space. Proceedings of the Machine Learning and Knowledge Discovery in Databases, Athens, Greece.10.1007/978-3-642-15880-3 ↗