journal article·2021-11-25Open access

A Novel K-Means Clustering Algorithm with a Noise Algorithm for Capturing Urban Hotspots

Xiaojuan Ran, Xiangbing Zhou, Mu Lei, Worawit Tepsan, Wu Deng

Applied Sciences· Volume 11· Issue 23

Abstract

With the development of cities, urban congestion is nearly an unavoidable problem for almost every large-scale city. Road planning is an effective means to alleviate urban congestion, which is a classical non-deterministic polynomial time (NP) hard problem, and has become an important research hotspot in recent years. A K-means clustering algorithm is an iterative clustering analysis algorithm that has been regarded as an effective means to solve urban road planning problems by scholars for the past several decades; however, it is very difficult to determine the number of clusters and sensitively initialize the center cluster. In order to solve these problems, a novel K-means clustering algorithm based on a noise algorithm is developed to capture urban hotspots in this paper. The noise algorithm is employed to randomly enhance the attribution of data points and output results of clustering by adding noise judgment in order to automatically obtain the number of clusters for the given data and initialize the center cluster. Four unsupervised evaluation indexes, namely, DB, PBM, SC, and SSE, are directly used to evaluate and analyze the clustering results, and a nonparametric Wilcoxon statistical analysis method is employed to verify the distribution states and differences between clustering results. Finally, five taxi GPS datasets from Aracaju (Brazil), San Francisco (USA), Rome (Italy), Chongqing (China), and Beijing (China) are selected to test and verify the effectiveness of the proposed noise K-means clustering algorithm by comparing the algorithm with fuzzy C-means, K-means, and K-means plus approaches. The compared experiment results show that the noise algorithm can reasonably obtain the number of clusters and initialize the center cluster, and the proposed noise K-means clustering algorithm demonstrates better clustering performance and accurately obtains clustering results, as well as effectively capturing urban hotspots.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Transportation Planning and Optimization · Data Management and Algorithms · Traffic Prediction and Management Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

International College of Digital Innovation, Chiang Mai University, Chaing Mai 50200, Thailand

School of Information and Engineering, Sichuan Tourism University, Chendu 610100, China

School of Computer Science and Technology, Aba Teachers University, Wenchuan 623002, China

School of Information and Engineering, Chengdu University, Chendu 610106, China

School of Electronic Information and Automation, Civil Aviation University of China, Tianjin 300300, China

Funding

Sichuan Science and Technology Program · A Ba Achievements Transformation Program · Chengdu Science and technology planning project

References (51)

Show source-provided references
1. Zhou, X., Gu, J., Shen, S., Ma, H., Miao, F., Zhang, H., and Gong, H. (2017). An automatic k-means clustering algorithm of gps data combining a novel niche genetic algorithm with noise and density. ISPRS Int. J. Geoinf., 6.10.3390/ijgi6120392 ↗
2. Detection of traffic congestion and incidents from GPS trace analysis10.1016/j.eswa.2016.12.018 ↗
3. Detecting urban road network accessibility problems using taxi GPS data10.1016/j.jtrangeo.2015.12.007 ↗
4. Mining urban recurrent congestion evolution patterns from GPS-equipped vehicle mobility data10.1016/j.ins.2016.06.033 ↗
5. Forecasting crude oil prices based on variational mode decomposition and random sparse Bayesian learning10.1016/j.asoc.2021.108032 ↗
6. Detecting spatiotemporal extents of traffic congestion: A density-based moving object clustering approach10.1080/13658816.2021.1905820 ↗
7. GPS-based citywide traffic congestion forecasting using CNN-RNN and C3D hybrid model
8. Analysis of road travel behaviour based on big trajectory data10.1049/iet-its.2019.0785 ↗
9. Analysis of spatio-temporal distribution characteristics of passenger travel behaviour based on online ride-sharing trajectory data10.1088/1742-6596/1187/5/052055 ↗
10. Siangsuebchart, S., Ninsawat, S., Witayangkurn, A., and Pravinvongvuth, S. (2021). Public transport gps probe and rail gate data for assessing the pattern of human mobility in the bangkok metropolitan region, Thailand. Sustainability, 13.10.3390/su13042178 ↗
11. Identifying mismatch between urban travel demand and transport network services using gps data: A case study in the fast-growing Chinese city of Harbin10.1016/j.neucom.2015.08.100 ↗
12. Tang, J., Gao, F., Liu, F., Zhang, W., and Qi, Y. (2019). Understanding Spatio-temporal characteristics of urban travel demand based on the combination of GWR and GLM. Sustainability, 11.10.3390/su11195525 ↗
13. Efficient reverse spatial and textual k nearest neighbor queries on road networks10.1016/j.knosys.2015.11.009 ↗
14. Road-network aware trajectory clustering: Integrating locality, flow, and density10.1109/TMC.2013.119 ↗
15. Quantum differential evolution with cooperative coevolution framework and hybrid mutation strategy for large scale optimization10.1016/j.knosys.2021.107080 ↗
16. Urban activity pattern classification using topic models from online geo-location data10.1016/j.trc.2014.04.003 ↗
17. Identifying Spatio-temporal patterns of bus bunching in urban networks10.1080/15472450.2020.1722949 ↗
18. A novel gate resource allocation method using improved PSO-based QEA
19. Exploring od patterns of interested region based on taxi trajectories10.1007/s12650-016-0357-7 ↗
20. Time-evolving o-d matrix estimation using high-speed GPS data streams10.1016/j.eswa.2015.08.048 ↗
21. A method for bus od matrix estimation using multisource data10.1155/2020/5740521 ↗
22. A conceptual view on trajectories10.1016/j.datak.2007.10.008 ↗
23. Luo, T., Zheng, X., Xu, G., Fu, K., and Ren, W. (2017). An improved DBSCAN algorithm to detect stops in individual trajectories. ISPRS Int. J. Geoinf., 6.10.3390/ijgi6030063 ↗
24. An enhanced MSIQDE algorithm with novel multiple strategies for global optimization problems
25. Time-focused clustering of trajectories of moving objects10.1007/s10844-006-9953-7 ↗
26. Midlatitude Klobuchar correction model based on the k-means clustering of ionospheric daily variations10.1007/s10291-019-0871-x ↗
27. Gu, Y.Y., Wang, Y.D., and Dong, S.H. (2020). Public traffic congestion estimation using an artificial neural network. ISPRS Int. J. Geoinf., 9.10.3390/ijgi9030152 ↗
28. A novel image-based convolutional neural network approach for traffic congestion estimation10.1016/j.eswa.2021.115037 ↗
29. A probabilistic estimation of traffic congestion using Bayesian network10.1016/j.measurement.2021.109051 ↗
30. Improved k-means algorithm based on density canopy10.1016/j.knosys.2018.01.031 ↗
31. Clustering stability-based evolutionary k-means10.1007/s00500-018-3280-0 ↗
32. Arthur, D., and Vassilvitskii, S. (2007, January 77–9). K-means++: The advantages of careful seeding. Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 2007, New Orleans, LA, USA.
33. Pattern Recognition with Fuzzy Objective Function Algorithms
34. A unified form of fuzzy c-means and k-means algorithms and its partitional implementation10.1016/j.knosys.2020.106731 ↗
35. Advantages of fuzzy k-means over k-means clustering in the classification of diffuse reflectance soil spectra: A case study with west African soils10.1016/j.geoderma.2018.09.004 ↗
36. Fuzzy clustering method based on improved weighted distance10.1155/2021/6687202 ↗
37. Genetic algorithm with healthy population and multiple streams sharing information for clustering10.1016/j.knosys.2016.09.030 ↗
38. Optimization of geochemical anomaly detection using a novel genetic k-means clustering (gkmc) algorithm10.1016/j.cageo.2019.104335 ↗
39. Robust deep k-means: An effective and simple method for data clustering10.1016/j.patcog.2021.107996 ↗
40. GBK-means clustering algorithm: An improvement to the k-means algorithm based on the bargaining game10.1016/j.knosys.2020.106672 ↗
41. A GPS location data clustering approach based on a niche genetic algorithm and hybrid K-means10.3233/IDA-192791 ↗
42. Identifying tourists and locals by K-means clustering method from mobile phone signaling data10.1061/JTEPBS.0000580 ↗
43. Rahman, M.A., and Islam, M. (2011, January 1–2). Seed-detective: A novel clustering technique using high quality seed for k-means on categorical and numerical attributes. Proceedings of the 9th Australasian Data Mining Conference (AusDM’11), Ballarat, Australia.
44. Automatic clustering using genetic algorithms
45. Piorkowski, M., Sarafijanovic-Djukic, N., and Grossglauser, M. (2021, July 07). Crawdad Dataset epfl/Mobility (v. 24 February 2009). Available online: http://crawdad.Org/epfl/mobility/20090224.
46. Zheng, Y., Liu, Y., Yuan, J., and Xie, X. (2011, January 17–21). Urban computing with taxicabs. Proceedings of the 13th International Conference on Ubiquitous Computing, Beijing, China.10.1145/2030112.2030126 ↗
47. A cluster separation measure10.1109/TPAMI.1979.4766909 ↗
48. Validity index for crisp and fuzzy clusters10.1016/j.patcog.2003.06.005 ↗
49. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
50. (2020). Nonparametric testing. Principles of Managerial Statistics and Data Science, John Wiley & Sons.
51. Zhou, X. (2018). Research on Intelligent Clustering Learning Algorithm for GNSS Data, Chengdu University of Technology.