K-Means-Based Nature-Inspired Metaheuristic Algorithms for Automatic Data Clustering Problems: Recent Advances and Future Directions
Source abstract
Abstract
K-means clustering algorithm is a partitional clustering algorithm that has been used widely in many applications for traditional clustering due to its simplicity and low computational complexity. This clustering technique depends on the user specification of the number of clusters generated from the dataset, which affects the clustering results. Moreover, random initialization of cluster centers results in its local minimal convergence. Automatic clustering is a recent approach to clustering where the specification of cluster number is not required. In automatic clustering, natural clusters existing in datasets are identified without any background information of the data objects. Nature-inspired metaheuristic optimization algorithms have been deployed in recent times to overcome the challenges of the traditional clustering algorithm in handling automatic data clustering. Some nature-inspired metaheuristics algorithms have been hybridized with the traditional K-means algorithm to boost its performance and capability to handle automatic data clustering problems. This study aims to identify, retrieve, summarize, and analyze recently proposed studies related to the improvements of the K-means clustering algorithm with nature-inspired optimization techniques. A quest approach for article selection was adopted, which led to the identification and selection of 147 related studies from different reputable academic avenues and databases. More so, the analysis revealed that although the K-means algorithm has been well researched in the literature, its superiority over several well-established state-of-the-art clustering algorithms in terms of speed, accessibility, simplicity of use, and applicability to solve clustering problems with unlabeled and nonlinearly separable datasets has been clearly observed in the study. The current study also evaluated and discussed some of the well-known weaknesses of the K-means clustering algorithm, for which the existing improvement methods were conceptualized. It is noteworthy to mention that the current systematic review and analysis of existing literature on K-means enhancement approaches presents possible perspectives in the clustering analysis research domain and serves as a comprehensive source of information regarding the K-means algorithm and its variants for the research community.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Metaheuristic Optimization Algorithms Research · Advanced Clustering Algorithms Research · Data Stream Mining Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, King Edward Road, Pietermaritzburg 3201, South Africa
College of Computer Science, University of Hafr Al Batin, Hafar Al Batin 39524, Saudi Arabia
References (100+)
Show source-provided references
1. Nature-inspired metaheuristic techniques for automatic clustering: A survey and performance study10.1007/s42452-020-2073-0 ↗
2. Some Methods for Classification and Analysis of Multivariate Observations
3. Kapil, S., Chawla, M., and Ansari, M.D. (2016, January 22–24). On K-Means Data Clustering Algorithm with Genetic Algorithm. Proceedings of the 2016 Fourth International Conference on Parallel, Distributed and Grid Computing (PDGC), Solan, India.10.1109/PDGC.2016.7913145 ↗
4. A Comparative Performance Study of Hybrid Firefly Algorithms for Automatic Data Clustering10.1109/ACCESS.2020.3006173 ↗
5. Automatic clustering algorithms: A systematic review and bibliometric analysis of relevant literature10.1007/s00521-020-05395-4 ↗
6. Automatic clustering using nature-inspired metaheuristics: A survey10.1016/j.asoc.2015.12.001 ↗
7. A Survey of Evolutionary Algorithms for Clustering10.1109/TSMCC.2008.2007252 ↗
8. Metaheuristics: A comprehensive overview and classification along with bibliometric analysis10.1007/s10462-020-09952-0 ↗
9. A review on particle swarm optimization algorithms and their applications to data clustering10.1007/s10462-010-9191-9 ↗
10. A survey on nature inspired metaheuristic algorithms for partitional clustering10.1016/j.swevo.2013.11.003 ↗
11. Research on particle swarm optimization based clustering: A systematic review of literature and techniques10.1016/j.swevo.2014.02.001 ↗
12. Mane, S.U., and Gaikwad, P.G. (2014, January 4–5). Nature Inspired Techniques for Data Clustering. Proceedings of the 2014 International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), Mumbai, India.10.1109/CSCITA.2014.6839297 ↗
13. Falkenauer, E. (1998). Genetic Algorithms and Grouping Problems, John Wiley & Sons, Inc.
14. A genetic algorithm approach to cluster analysis10.1016/S0898-1221(99)00090-5 ↗
15. Okwu, M.O., and Tartibu, L.K. (2020). Metaheuristic Optimization: Nature-Inspired Algorithms Swarm and Computational Intelligence, Theory and Applications, Springer Nature.10.1007/978-3-030-61111-8 ↗
16. Comparison of Nature Inspired Metaheuristic Algorithms
17. Engelbrecht, A.P. (2007). Computational Intelligence: An Introduction, John Wiley & Sons.10.1002/9780470512517 ↗
18. Automatic Data Clustering Using Hybrid Firefly Particle Swarm Optimization Algorithm10.1109/ACCESS.2019.2960925 ↗
19. Rajakumar, R., Dhavachelvan, P., and Vengattaraman, T. (2016, January 21–26). A Survey on Nature Inspired Meta-Heuristic Algorithms with its Domain Specifications. Proceedings of the 2016 International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.10.1109/CESYS.2016.7889811 ↗
20. Ezugwu, A.E. (2021). Advanced discrete firefly algorithm with adaptive mutation–based neighborhood search for scheduling unrelated parallel machines with sequence–dependent setup times. Int. J. Intell. Syst., 1–42.10.1002/int.22733 ↗
21. Genetic algorithms10.1038/scientificamerican0792-66 ↗
22. Sivanandam, S.N., and Deepa, S.N. (2008). Genetic algorithms. Introduction to Genetic Algorithms, Springer.10.1007/978-3-540-73190-0_2 ↗
23. Genetic K-means algorithm10.1109/3477.764879 ↗
24. An evolutionary technique based on K-means algorithm for optimal clustering in RN10.1016/S0020-0255(02)00208-6 ↗
25. Cheng, S.S., Chao, Y.H., Wang, H.M., and Fu, H.C. (2006, January 20–24). A prototypes-embedded genetic k-means algorithm. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.
26. A genetic algorithm using hyper-quadtrees for low-dimensional k-means clustering10.1109/TPAMI.2006.66 ↗
27. A genetic algorithm that exchanges neighboring centers for k-means clustering10.1016/j.patrec.2007.08.006 ↗
28. Dai, W., Jiao, C., and He, T. (2007, January 26–28). Research of K-Means Clustering Method based on Parallel Genetic Algorithm. Proceedings of the Third International Conference on Intelligent Information Hiding and Multimedia Signal. Processing (IIH-MSP 2007), Kaohsiung, Taiwan.10.1109/IIH-MSP.2007.259 ↗
29. A genetic algorithm with gene rearrangement for K-means clustering10.1016/j.patcog.2008.11.006 ↗
30. A niching genetic k-means algorithm and its applications to gene expression data10.1007/s00500-008-0386-9 ↗
31. A quantum-inspired genetic algorithm for k-means clustering10.1016/j.eswa.2009.12.017 ↗
32. A hybrid clustering technique combining a novel genetic algorithm with K-Means10.1016/j.knosys.2014.08.011 ↗
33. A Hybrid MapReduce-based k-Means Clustering using Genetic Algorithm for Distributed Datasets10.1007/s11227-017-2182-8 ↗
34. Combining K-Means and a genetic algorithm through a novel arrangement of genetic operators for high quality clustering10.1016/j.eswa.2017.09.005 ↗
35. Zhang, H., and Zhou, X. (2018, January 26–28). A Novel Clustering Algorithm Combining Niche Genetic Algorithm with Canopy and K-Means. Proceedings of the 2018 International Conference on Artificial Intelligence and Big Data (ICAIBD), Chengdu, China.10.1109/ICAIBD.2018.8396161 ↗
36. A hybrid approach using genetic algorithm and the differential evolution heuristic for enhanced initialization of the k-means algorithm with applications in text clustering10.1007/s00500-018-3289-4 ↗
37. An enhanced genetic algorithm with new mutation for cluster analysis10.1007/s00180-019-00871-5 ↗
38. Optimization of geochemical anomaly detection using a novel genetic K-means clustering (GKMC) algorithm10.1016/j.cageo.2019.104335 ↗
39. Integration of self-organizing feature maps neural network and genetic K-means algorithm for market segmentation10.1016/j.eswa.2005.07.036 ↗
40. Li, X., Zhang, L., Li, Y., and Wang, Z. (2010, January 16–18). An Improved k-Means Clustering Algorithm Combined with the Genetic Algorithm. Proceedings of the 6th International Conference on Digital Content, Multimedia Technology and Its Applications, Seoul, Korea.
41. Karegowda, A.G., Vidya, T., Jayaram, M.A., and Manjunath, A.S. (2013). Improving Performance of k-Means Clustering by Initializing Cluster Centers using Genetic Algorithm and Entropy based Fuzzy Clustering for Categorization of Diabetic Patients. Proceedings of International Conference on Advances in Computing, Springer.10.1007/978-81-322-0740-5_108 ↗
42. A hybrid grey-based k-means and genetic algorithm for project selection
43. Lu, Z., Zhang, K., He, J., and Niu, Y. (2016). Applying k-Means Clustering and Genetic Algorithm for Solving MTSP. International Conference on Bio-Inspired Computing: Theories and Applications, Springer.10.1007/978-981-10-3614-9_34 ↗
44. An Energy-Aware Routing Protocol for Wireless Sensor Networks Based on New Combination of Genetic Algorithm & k-means10.1016/j.procs.2015.12.163 ↗
45. Zhou, X., Gu, J., Shen, S., Ma, H., Miao, F., Zhang, H., and Gong, H. (2017). An Automatic K-Means Clustering Algorithm of GPS Data Combining a Novel Niche Genetic Algorithm with Noise and Density. ISPRS Int. J. Geo-Inf., 6.10.3390/ijgi6120392 ↗
46. Fuzzy c-means and K-means clustering with genetic algorithm for identification of homogeneous regions of groundwater quality10.1007/s00521-018-3768-7 ↗
47. A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data10.1007/s10462-013-9400-4 ↗
48. A population-based clustering technique using particle swarm optimization and k-means10.1007/s11047-016-9542-9 ↗
49. Van der Merwe, D.W., and Engelbrecht, A.P. (2003, January 8–12). Data Clustering using Particle Swarm Optimization. Proceedings of the 2003 Congress on Evolutionary Computation, CEC’03, Canberra, Australia.
50. Dynamic clustering using particle swarm optimization with application in image segmentation10.1007/s10044-005-0015-5 ↗
51. Alam, S., Dobbie, G., and Riddle, P. (2008, January 21–23). An Evolutionary Particle Swarm Optimization Algorithm for Data Clustering. Proceedings of the 2008 IEEE Swarm Intelligence Symposium, St. Louis, MO, USA.10.1109/SIS.2008.4668294 ↗
52. Kao, I.W., Tsai, C.Y., and Wang, Y.C. (2007, January 2). An effective particle swarm optimization method for data clustering. Proceedings of the 2007 IEEE International Conference on Industrial Engineering and Engineering Management, Singapore.10.1109/IEEM.2007.4419249 ↗
53. An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis10.1016/j.asoc.2009.07.001 ↗
54. Particle swarm optimization: Hybridization perspectives and experimental illustrations
55. Chaotic particle swarm optimization for data clustering10.1016/j.eswa.2011.05.027 ↗
56. Chen, C.-Y., and Ye, F. (2012, January 2–3). Particle Swarm Optimization Algorithm and its Application to Clustering Analysis. Proceedings of the 17th Conference on Electrical Power Distribution, Tehran, Iran.
57. Data clustering using variants of rapid centroid estimation10.1109/TEVC.2013.2281545 ↗
58. Particle swarm optimization method for image clustering10.1142/S0218001405004083 ↗
59. Chen, J., and Zhang, H. (2007, January 21–25). Research on Application of Clustering Algorithm based on PSO for the Web Usage Pattern. Proceedings of the 2007 International Conference on Wireless Communications, Networking and Mobile Computing, Honolulu, HI, USA.10.1109/WICOM.2007.916 ↗
60. A hybridized approach to data clustering10.1016/j.eswa.2007.01.028 ↗
61. Kao, Y., and Lee, S.Y. (2009, January 20–22). Combining K-Means and Particle Swarm Optimization for Dynamic Data Clustering Problems. Proceedings of the 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, Shanghai, China.10.1109/ICICISYS.2009.5358020 ↗
62. An efficient hybrid data clustering method based on K-harmonic means and Particle Swarm Optimization10.1016/j.eswa.2009.02.003 ↗
63. Particle swarm optimization with selective particle regeneration for data clustering10.1016/j.eswa.2010.11.082 ↗
64. Prabha, K.A., and Visalakshi, N.K. (2014, January 6–7). Improved Particle Swarm Optimization based k-Means Clustering. Proceedings of the 2014 International Conference on Intelligent Computing Applications, Coimbatore, India.10.1109/ICICA.2014.21 ↗
65. Integrating Fuzzy K-Means, Particle Swarm Optimization, and Imperialist Competitive Algorithm for Data Clustering10.1007/s13369-015-1826-3 ↗
66. Nayak, S., Panda, C., Xalxo, Z., and Behera, H.S. (2015). An Integrated Clustering Framework Using Optimized K-means with Firefly and Canopies. Computational Intelligence in Data Mining-Volume 2, Springer.10.1007/978-81-322-2208-8_31 ↗
67. Least squares quantization in PCM10.1109/TIT.1982.1056489 ↗
68. Ratanavilisagul, C. (2020, January 19–21). A Novel Modified Particle Swarm Optimization Algorithm with Mutation for Data Clustering Problem. Proceedings of the 5th International Conference on Computational Intelligence and Applications (ICCIA), Beijing, China.10.1109/ICCIA49625.2020.00018 ↗
69. Paul, S., De, S., and Dey, S. (2020, January 2–4). A Novel Approach of Data Clustering Using An Improved Particle Swarm Optimization Based K–Means Clustering Algorithm. Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Virtual.10.1109/CONECCT50063.2020.9198685 ↗
70. Jie, Y., and Yibo, S. (2019, January 21–23). The Study for Data Mining of Distribution Network Based on Particle Swarm Optimization with Clustering Algorithm Method. Proceedings of the 2019 4th International Conference on Power and Renewable Energy (ICPRE), Chengdu, China.10.1109/ICPRE48497.2019.9034814 ↗
71. Chen, X., Miao, P., and Bu, Q. (2019, January 12–14). Image Segmentation Algorithm Based on Particle Swarm Optimization with K-means Optimization. Proceedings of the 2019 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China.10.1109/ICPICS47731.2019.8942442 ↗
72. Yang, X.S. (2009, January 26–28). Firefly Algorithms for Multimodal Optimization. Proceedings of the International Symposium on Stochastic Algorithms, Sapporo, Japan.10.1007/978-3-642-04944-6_14 ↗
73. Improving K-means clustering with enhanced Firefly Algorithms10.1016/j.asoc.2019.105763 ↗
74. Hassanzadeh, T., and Meybodi, M.R. (2012, January 2–3). A New Hybrid Approach for Data Clustering using Firefly Algorithm and K-Means. Proceedings of the 16th CSI c (AISP 2012), Fars, Iran.10.1109/AISP.2012.6313708 ↗
75. Mathew, J., and Vijayakumar, R. (2014, January 22–24). Scalable Parallel Clustering Approach for Large Data using Parallel K Means and Firefly Algorithms. Proceedings of the 2014 International Conference on High. Performance Computing and Applications (ICHPCA), Bhubaneswar, India.10.1109/ICHPCA.2014.7045322 ↗
76. Evolutionary Improved Swarm-based Hybrid K-Means Algorithm for Cluster Analysis
77. A novel hybrid approach for real world data clustering algorithm based on fuzzy C-means and firefly algorithm
78. Behera, H., and Mohapatra, D. (2017). Cluster Analysis Using Firefly-Based K-means Algorithm: A Combined Approach. Computational Intelligence in Data Mining. Advances in Intelligent Systems and Computing, Springer.
79. A hybrid approach for color image quantization using k-means and firefly algorithms
80. Taiwanese export trade forecasting using firefly algorithm based K-means algorithm and SVR with wavelet transform10.1016/j.cie.2016.07.012 ↗
81. Hybridization of K-Means and Firefly Algorithm for intrusion detection system10.1007/s13198-017-0683-8 ↗
82. Combined fuzzy clustering and firefly algorithm for privacy preserving in social networks10.1016/j.eswa.2019.112968 ↗
83. HimaBindu, G., Kumar, C.R., Hemanand, C., and Krishna, N.R. (2020). Hybrid clustering algorithm to process big data using firefly optimization mechanism. Mater. Today Proc.10.1016/j.matpr.2020.10.273 ↗
84. A novel kernel extreme learning machine model coupled with K-means clustering and firefly algorithm for estimating monthly reference evapotranspiration in parallel computation10.1016/j.agwat.2020.106624 ↗
85. Bat algorithm: A novel approach for global engineering optimization10.1108/02644401211235834 ↗
86. K-medoids clustering technique using bat algorithm
87. Dynamic frequency based parallel k-bat algorithm for massive data clustering (DFBPKBA)10.1007/s13198-017-0665-x ↗
88. Pavez, L., Altimiras, F., and Villavicencio, G. (2020). A K-means Bat Algorithm Applied to the Knapsack Problem. Proceedings of the Computational Methods in Systems and Software, Springer.10.1007/978-3-030-63319-6_57 ↗
89. Gan, J.E., and Lai, W.K. (2019, January 19). Automated Grading of Edible Birds Nest Using Hybrid Bat Algorithm Clustering Based on K-Means. Proceedings of the 2019 IEEE International Conference on Automatic Control. and Intelligent Systems (I2CACIS), Kuala Lumpur, Malaysia.10.1109/I2CACIS.2019.8825077 ↗
90. Hybrid enhanced shuffled bat algorithm for data clustering
91. Yang, X.S. (2012). Flower pollination algorithm for global optimization. Proceedings of the International Conference on Unconventional Computing and Natural Computation, Springer.10.1007/978-3-642-32894-7_27 ↗
92. Jensi, R., and Jiji, G.W. (2015). Hybrid data clustering approach using k-means and flower pollination algorithm. arXiv.
93. Flower pollination-based K-means algorithm for medical image compression
94. Karaboga, D. (2005). An Idea Based on Honey Bee Swarm for Numerical Optimization, Erciyes University, Engineering Faculty, Computer Engineering Department. Technical Report-tr06.
95. Clustering Analysis with Combination of Artificial Bee Colony Algorithm and k-Means Technique10.7763/IJCTE.2014.V6.852 ↗
96. A Novel Hybrid Data Clustering Algorithm Based on Artificial Bee Colony Algorithm and K-Means10.1049/cje.2015.10.006 ↗
97. Bonab, M.B., Hashim, S.Z.M., Alsaedi, A.K.Z., and Hashim, U.R. (2015). Modified K-Means Combined with Artificial Bee Colony Algorithm and Differential Evolution for Color Image Segmentation. Computational Intelligence in Information Systems, Springer.10.1007/978-3-319-13153-5_22 ↗
98. Jin, Q., Lin, N., and Zhang, Y. (2021). K-Means Clustering Algorithm Based on Chaotic Adaptive Artificial Bee Colony. Algorithms, 14.10.3390/a14020053 ↗
99. Dasu, M.V., Reddy, P.V.N., and Reddy, S.C.M. (2020). Classification of Remote Sensing Images Based on K-Means Clustering and Artificial Bee Colony Optimization. Advances in Cybernetics, Cognition, and Machine Learning for Communication Technologies, Springer.10.1007/978-981-15-3125-5_7 ↗
100. Huang, S.C. (2020). Color Image Quantization Based on the Artificial Bee Colony and Accelerated K-means Algorithms. Symmetry, 12.10.3390/sym12081222 ↗