journal article·2023Open access

Subspace Clustering in High-Dimensional Data Streams: A Systematic Literature Review

Nur Laila Ab Ghani, Izzatdin Abdul Aziz, Said Jadid AbdulKadir

Computers, Materials & Continua· Volume 75· Issue 2

Abstract

Clustering high dimensional data is challenging as data dimensionality increases the distance between data points, resulting in sparse regions that degrade clustering performance. Subspace clustering is a common approach for processing high-dimensional data by finding relevant features for each cluster in the data space. Subspace clustering methods extend traditional clustering to account for the constraints imposed by data streams. Data streams are not only high-dimensional, but also unbounded and evolving. This necessitates the development of subspace clustering algorithms that can handle high dimensionality and adapt to the unique characteristics of data streams. Although many articles have contributed to the literature review on data stream clustering, there is currently no specific review on subspace clustering algorithms in high-dimensional data streams. Therefore, this article aims to systematically review the existing literature on subspace clustering of data streams in high-dimensional streaming environments. The review follows a systematic methodological approach and includes 18 articles for the final analysis. The analysis focused on two research questions related to the general clustering process and dealing with the unbounded and evolving characteristics of data streams. The main findings relate to six elements: clustering process, cluster search, subspace search, synopsis structure, cluster maintenance, and evaluation measures. Most algorithms use a two-phase clustering approach consisting of an initialization stage, a refinement stage, a cluster maintenance stage, and a final clustering stage. The density-based top-down subspace clustering approach is more widely used than the others because it is able to distinguish true clusters and outliers using projected micro-clusters. Most algorithms implicitly adapt to the evolving nature of the data stream by using a time fading function that is sensitive to outliers. Future work can focus on the clustering framework, parameter optimization, subspace search techniques, memory-efficient synopsis structures, explicit cluster change detection, and intrinsic performance metrics. This article can serve as a guide for researchers interested in high-dimensional subspace clustering methods for data streams.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Clustering Algorithms Research · Data Stream Mining Techniques · Image and Video Quality Assessment

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (51)

Show source-provided references
1. Data stream clustering: A review10.1007/s10462-020-09874-x ↗
2. PSubCLUS: A parallel subspace clustering algorithm based on spark10.1109/ACCESS.2020.3047094 ↗
3. Estimating distance threshold for greedy subspace clustering10.1016/j.eswa.2019.06.011 ↗
4. Rutkowski · Stream Data Mining: Algorithms and Their Probabilistic Properties · 2020 · 56 · 13
5. Scarcity of labels in non-stationary data streams: A survey10.1145/3494832 ↗
6. Data stream analysis: Foundations, major tasks and tools
7. A systematic review of density grid-based clustering for data streams10.1109/ACCESS.2021.3134704 ↗
8. Survey: Clustering techniques of data stream
9. A comprehensive review on evolving data stream clustering
10. Scalable clustering algorithms for big data: A review10.1109/ACCESS.2021.3084057 ↗
11. An evaluation of data stream clustering algorithms10.1002/sam.11380 ↗
12. Optimizing data stream representation: An extensive survey on stream clustering algorithms10.1007/s12599-019-00576-5 ↗
13. A review on data stream classification
14. Data stream clustering techniques, applications, and models: Comparative analysis and discussion10.3390/bdcc2040032 ↗
15. A comparative study on data stream clustering algorithms
16. Data stream mining techniques: A review
17. Subspace clustering and some soft variants
18. Subspace clustering—A survey10.1007/978-981-13-1402-5_16 ↗
19. Systematic review of clustering high-dimensional and large datasets10.1145/3132088 ↗
20. Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering10.1145/1497577.1497578 ↗
21. The ABC of systematic literature review: The basic methodological guidance for beginners10.1007/s11135-020-01059-6 ↗
22. The art of crafting a systematic literature review in entrepreneurship research10.1007/s11365-020-00635-4 ↗
23. On high dimensional projected clustering of data streams10.1007/s10618-005-0645-7 ↗
24. A weighted subspace clustering algorithm in high-dimensional data streams
25. Clustering algorithm for high dimensional data stream over sliding windows
26. Density-based data streams subspace clustering over weighted sliding windows
27. SE-stream: Dimension projection for evolution-based clustering of high dimensional data streams
28. SED-stream: Discriminative dimension selection for evolution-based clustering of high dimensional data streams10.1504/IJISTA.2014.065174 ↗
29. Constraint-based discriminative dimension selection for high-dimensional stream clustering10.26555/ijain.v4i3.271 ↗
30. Density-based projected clustering over high dimensional data streams
31. A novel high dimensional and high speed data streams algorithm: HSDStream10.14569/IJACSA.2016.070952 ↗
32. Density-based projected clustering of data streams
33. Towards an efficient real-time kernel function stream clustering method via shared nearest-neighbor density for the IIoT10.1016/j.ins.2021.02.025 ↗
34. A grid-based clustering algorithm for high-dimensional data streams
35. A grid-based subspace clustering algorithm for high-dimensional data streams
36. Subspace clustering of high dimensional data streams
37. A fast subspace partition clustering algorithm for high dimensional data streams
38. HDG-Tree: A structure for clustering high-dimensional data streams
39. A generic summary structure for arbitrarily oriented subspace clustering in data streams
40. Detecting arbitrarily oriented subspace clusters in data streams using hough transform
41. ASCRClu: An adaptive subspace combination and reduction algorithm for clustering of high-dimensional data10.1007/s10044-020-00884-7 ↗
42. Reviews in online data stream and active learning for cyber intrusion detection-A systematic literature review
43. A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects10.1016/j.engappai.2022.104743 ↗
44. Big data stream analysis: A systematic literature review10.1186/s40537-019-0210-7 ↗
45. A review on data stream clustering algorithms over sliding windows
46. Automatic clustering algorithms: A systematic review and bibliometric analysis of relevant literature10.1007/s00521-020-05395-4 ↗
47. Soft subspace clustering with entropy constraints
48. Reference vector-based multi-objective clustering for high-dimensional data10.1016/j.asoc.2019.02.043 ↗
49. An overview on concept drift learning10.1109/ACCESS.2018.2886026 ↗
50. Concept drift detection in data stream mining: A literature review10.1016/j.jksuci.2021.11.006 ↗
51. Using internal evaluation measures to validate the quality of diverse stream clustering algorithms10.1007/s40595-016-0086-9 ↗