journal article·2020-03-10Open access

An Ensemble of Locally Reliable Cluster Solutions

Huan Niu, Nasim Khozouie, Hamid Parvin, Hamid Alinejad-Rokny, Amin Beheshti, Mohammad Reza Mahmoudi

Applied Sciences· Volume 10· Issue 5

Abstract

Clustering ensemble indicates to an approach in which a number of (usually weak) base clusterings are performed and their consensus clustering is used as the final clustering. Knowing democratic decisions are better than dictatorial decisions, it seems clear and simple that ensemble (here, clustering ensemble) decisions are better than simple model (here, clustering) decisions. But it is not guaranteed that every ensemble is better than a simple model. An ensemble is considered to be a better ensemble if their members are valid or high-quality and if they participate according to their qualities in constructing consensus clustering. In this paper, we propose a clustering ensemble framework that uses a simple clustering algorithm based on kmedoids clustering algorithm. Our simple clustering algorithm guarantees that the discovered clusters are valid. From another point, it is also guaranteed that our clustering ensemble framework uses a mechanism to make use of each discovered cluster according to its quality. To do this mechanism an auxiliary ensemble named reference set is created by running several kmeans clustering algorithms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Complex Network Analysis Techniques · Advanced Clustering Algorithms Research · Data Management and Algorithms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Communication Engineering, Communication University of China, Beijing 100024, China

Department of computer Engineering, Faculty of Engineering, Yasouj University, Yasouj 759, Iran

Department of Computer Science, Nourabad Mamasani Branch, Islamic Azad University, Mamasani 7351, Iran

Young Researchers and Elite Club, Nourabad Mamasani Branch, Islamic Azad University, Mamasani 7351, Iran

Systems Biology and Health Data Analytics Lab, The Graduate School of Biomedical Engineering, UNSW Sydney, Sydney 2052, Australia

School of Computer Science and Engineering, UNSW Australia, Sydney 2052, Australia

Department of Computing, Macquarie University, Sydney 2109, Australia

Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam

Department of Statistics, Faculty of Science, Fasa University, Fasa 7461, Iran

References (66)

Show source-provided references
1. Han, J., and Kamber, M. (2001). Data Mining: Concepts and Techniques, Morgan Kaufmann.
2. Adaptive Computing-Plus-Communication Optimization Framework for Multimedia Processing in Cloud Systems
3. D-FICCA: A density-based fuzzy imperialist competitive clustering algorithm for intrusion detection in wireless sensor networks10.1016/j.measurement.2014.04.034 ↗
4. A new acute leukaemia-automated classification system10.1080/21681163.2016.1234948 ↗
5. Developing a fuzzy clustering model for better energy use in farm management systems10.1016/j.rser.2015.03.029 ↗
6. Jain, A.K., and Dubes, R.C. (1988). Algorithms for Clustering Data, Prentice Hall.
7. Data clustering: 50 years beyond K-means10.1016/j.patrec.2009.09.011 ↗
8. Zhou, Z. (2012). Ensemble Methods: Foundations and Algorithms, CRC Press.10.1201/b12207 ↗
9. Combining multiple clusterings using evidence accumulation10.1109/TPAMI.2005.113 ↗
10. Evaluation of stability of k-means cluster ensembles with respect to random initialization10.1109/TPAMI.2006.226 ↗
11. Spectral clustering ensemble applied to SAR image segmentation10.1109/TGRS.2008.918647 ↗
12. Clustering aggregation10.1145/1217299.1217303 ↗
13. Law, M., Topchy, A., and Jain, A. (July, January 27). Multi-objective data clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.
14. Hybrid fuzzy cluster ensemble framework for tumor clustering from bio-molecular data10.1109/TCBB.2013.59 ↗
15. Bagging for path-based clustering10.1109/TPAMI.2003.1240115 ↗
16. Topchy, A., Minaei-Bidgoli, B., and Jain, A. (2004, January 26). Adaptive clustering ensembles. Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK.10.1109/ICPR.2004.1334105 ↗
17. Clusterer ensemble10.1016/j.knosys.2005.11.003 ↗
18. Resampling-based selective clustering ensembles10.1016/j.patrec.2008.10.007 ↗
19. Fern, X., and Brodley, C. (2003, January 21–24). Random projection for high dimensional data clustering: A cluster ensemble approach. Proceedings of the International Conference on Machine Learning, Washington, DC, USA.
20. Zhou, P., Du, L., Shi, L., Wang, H., Shi, L., and Shen, Y.D. (2015). Learning a robust consensus matrix for clustering ensemble via Kullback-Leibler divergence minimization. 25th International Joint Conference on Artificial Intelligence, AAAI Publications.
21. Adaptive noise immune cluster ensemble using affinity propagation10.1109/TKDE.2015.2453162 ↗
22. Metacluster-based projective clustering ensembles
23. Hybrid Sampling-Based Clustering Ensemble with Global and Local Constitutions10.1109/TNNLS.2015.2430821 ↗
24. Effects of resampling method and adaptation on clustering ensemble efficacy10.1007/s10462-011-9295-x ↗
25. Fred, A., and Jain, A.K. (2002, January 11–15). Data clustering using evidence accumulation. Proceedings of the 16th International Conference on Pattern Recognition, Quebec City, QC, Canada.
26. Temporal data clustering via weighted clustering ensemble with different representations10.1109/TKDE.2010.112 ↗
27. A link-based approach to the cluster ensemble problem10.1109/TPAMI.2011.84 ↗
28. A link-based cluster ensemble approach for categorical data clustering10.1109/TKDE.2010.268 ↗
29. Cluster ensembles: A knowledge reuse framework for combining multiple partitions
30. Fern, X., and Brodley, C. (2004, January 4–8). Solving cluster ensemble problems by bipartite graph partitioning. Proceedings of the 21st International Conference on Machine Learning, Banff, AB, Canada.10.1145/1015330.1015414 ↗
31. Ensemble clustering using factor graph10.1016/j.patcog.2015.08.015 ↗
32. Combining multiple clusterings using similarity graph10.1016/j.patcog.2010.09.008 ↗
33. Boulis, C., and Ostendorf, M. (2004). Combining multiple clustering systems. European Conference on Principles and Practice of Knowledge Discovery in Databases, Springer.10.1007/978-3-540-30116-5_9 ↗
34. A scalable framework for cluster ensembles10.1016/j.patcog.2008.09.027 ↗
35. Long, B., Zhang, Z., and Yu, P.S. (2005, January 27–30). Combining multiple clusterings by soft correspondence. Proceedings of the 4th IEEE International Conference on Data Mining, Houston, TX, USA.
36. Finding median partitions using information theoretical based genetic algorithms
37. Clustering ensembles: Models of consensus and weak partitions10.1109/TPAMI.2005.237 ↗
38. Bayesian cluster ensembles10.1002/sam.10098 ↗
39. A cluster ensemble method for clustering categorical data10.1016/j.inffus.2004.03.001 ↗
40. Nguyen, N., and Caruana, R. (2007, January 28–31). Consensus Clusterings. Proceedings of the Seventh IEEE International Conference on Data Mining, Omaha, NE, USA.10.1109/ICDM.2007.73 ↗
41. Extensions to the k-means algorithm for clustering large data sets with categorical values10.1023/A:1009769707641 ↗
42. A Comprehensive Study of Clustering Ensemble Weighting Based on Cluster Quality and Diversity10.1007/s10044-017-0676-x ↗
43. Elite fuzzy clustering ensemble based on clustering diversity and quality measures10.1007/s10489-018-1332-x ↗
44. Cluster ensemble selection based on a new cluster stability measure10.3233/IDA-140647 ↗
45. Alizadeh, H., Minaei-Bidgoli, B., and Parvin, H. (2011). A New Criterion for Clusters Validation. Artificial Intelligence Applications and Innovations (AIAI 2011), Springer. IFIP, Part I.10.1007/978-3-642-23960-1_14 ↗
46. Clustering ensemble selection considering quality and diversity10.1007/s10462-018-9642-2 ↗
47. Diversity Based Cluster Weighting in Cluster Ensemble: An Information Theory Approach10.1007/s10462-019-09701-y ↗
48. Method for Determining the Optimal Number of Clusters Based on Agglomerative Hierarchical Clustering10.1109/TNNLS.2016.2608001 ↗
49. Chameleon: A hierarchical clustering algorithm using dynamic modeling10.1109/2.781637 ↗
50. Ji, Y., and Xia, L. (2016, January 4–6). Improved Chameleon: A Lightweight Method for Identity Verification in Near Field Communication. Proceedings of the 2016 International Symposium on Computer, Consumer and Control (IS3C), Xi’an, China.10.1109/IS3C.2016.106 ↗
51. Some methods for classification and analysis of multivariate observations
52. Dodge, Y. (1987). Clustering by Means of Medoids, in Statistical Data Analysis Based on the L1—Norm and Related Methods, North-Holland.
53. Some new indexes of cluster validity10.1109/3477.678624 ↗
54. On cluster validity for the fuzzy c-means model10.1109/91.413225 ↗
55. Guha, S., Rastogi, R., and Shim, K. (1998, January 1–4). Cure: An efficient clustering algorithm for large databases. Proceedings of the Conference on Management of Data (ACM SIGMOD), Seattle, WA, USA.10.1145/276304.276312 ↗
56. Sneath, P.H.A., and Sokal, R.R. (1973). Numerical Taxonomy, Freeman.
57. Step-wise clustering procedures10.1080/01621459.1967.10482890 ↗
58. Normalized cuts and image segmentation
59. Dietterich, T.G., Becker, S., and Ghahramani, Z. (2002). On Spectral Clustering: Analysis and an Algorithm. Advances in Neural Information Processing Systems, MIT Press.10.7551/mitpress/1120.001.0001 ↗
60. (2016, February 19). UCI Machine Learning Repository. Available online: http://www.ics.uci.edu/mlearn/ML-Repository.html.
61. Press, W., Teukolsky, S.A., Vetterling, W.T., and Flannery, B.P. (2007). Conditional Entropy and Mutual Information. Numerical Recipes: The Art of Scientific Computing, Cambridge University Press. [3rd ed.].
62. Simoudis, E., Han, J., and Fayyad, U.M. (1996). A density-based algorithm for discovering clusters in large spatial databases with noise. KDD-96: Proceedings: Second International Conference on Knowledge Discovery and Data Mining, AAAI Press.
63. Clustering by fast search and find of density peaks10.1126/science.1242072 ↗
64. A clustering ensemble framework based on elite selection of weighted clusters10.1007/s11634-013-0130-x ↗
65. A clustering ensemble framework based on selection of fuzzy weighted clusters in a locally adaptive clustering algorithm10.1007/s10044-013-0364-4 ↗
66. Approximate statistical tests for comparing supervised classification learning algorithms10.1162/089976698300017197 ↗