STRP-DBSCAN: A Parallel DBSCAN Algorithm Based on Spatial-Temporal Random Partitioning for Clustering Trajectory Data
Source abstract
Abstract
Trajectory clustering algorithms analyze the movement trajectory of the target objects to mine the potential movement trend, regularity, and behavioral patterns of the object. Therefore, the trajectory clustering algorithm has a wide range of applications in the fields of traffic flow analysis, logistics and transportation management, and crime analysis. Existing algorithms do not make good use of the temporal attributes of trajectory data, resulting in a long clustering time and low clustering accuracy of spatial-temporal trajectory data. Meanwhile, the density-based clustering algorithms represented by DBSCAN are very sensitive to the clustering parameters. The radius value Eps and the minimal points number MinPts within Eps radius, defined by the user, have a significant impact on the clustering results, and tuning these parameters is difficult. In this paper, we present STRP-DBSCAN, a parallel DBSCAN algorithm based on spatial-temporal random partitioning for clustering trajectory data. It adopts spatial-temporal random partitioning to distribute balanced computation among different computing nodes and reduce the communication overhead of the parallel clustering algorithm, thus improving the execution efficiency of the DBSCAN algorithm. We also present the PER-SAC algorithm, which uses deep reinforcement learning to combine the prioritized experience replay (PER) and the soft actor-critic (SAC) algorithm for autotuning the optimal parameters of DBSCAN. The experimental results show that STRP-DBSCAN effectively reduces the clustering time of spatial-temporal trajectory data by up to 96.2% and 31.2% compared to parallel DBSCAN and the state-of-the-art RP-DBSCAN. The PER-SAC algorithm also outperforms the state-of-the-art DBSCAN parameter tuning algorithms and improves the clustering accuracy by up to 8.8%. At the same time, the proposed algorithm obtains a higher stability of clustering accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Management and Algorithms · Advanced Clustering Algorithms Research · Time Series Analysis and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Geo-Information Engineering, Xi’an Research Institute of Surveying and Mapping, Xi’an 710054, China
School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an 710049, China
East-China Research Institute of Computer Technology, Shanghai 201818, China
References (41)
Show source-provided references
1. Weighted spatio-temporal taxi trajectory big data mining for regional traffic estimation10.1016/j.physa.2021.126645 ↗
2. Maritime traffic flow clustering analysis by density based trajectory clustering with noise10.1016/j.oceaneng.2022.111001 ↗
3. Trajectory Modeling of Spatio-Temporal Trends in COVID-19 Incidence in Flint and Genesee County, Michigan10.1016/j.annepidem.2021.12.005 ↗
4. The global k-means clustering algorithm10.1016/S0031-3203(02)00060-2 ↗
5. Ester, M., Kriegel, H.P., Sander, J., and Xu, X. (1996, January 2–4). A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the KDD-96 Proceedings, Oregon, Portland.
6. Huang, M., Bao, Q., Zhang, Y., and Feng, W. (2019). A hybrid algorithm for forecasting financial time series data based on DBSCAN and SVR. Information, 10.10.3390/info10030103 ↗
7. Consumer clusters detection with geo-tagged social network data using DBSCAN algorithm: A case study of the Pearl River Delta in China
8. ST-DBSCAN: An algorithm for clustering spatial–temporal data10.1016/j.datak.2006.01.013 ↗
9. Segmented trajectory clustering-based destination prediction in IoVs10.1109/ACCESS.2020.2998063 ↗
10. Song, H., and Lee, J.-G. (2018, January 10–15). RP-DBSCAN: A superfast parallel DBSCAN algorithm based on random partitioning. Proceedings of the 2018 International Conference on Management of Data, Houston, TX, USA.10.1145/3183713.3196887 ↗
11. Rdusseeun, L., and Kaufman, P. (September, January 31). Clustering by means of medoids. Proceedings of the Statistical Data Analysis Based on the L1 Norm Conference, Neuchatel, Switzerland.
12. BIRCH: A new data clustering algorithm and its applications10.1023/A:1009783824328 ↗
13. CURE: An efficient clustering algorithm for large databases10.1145/276305.276312 ↗
14. Wang, W., Yang, J., and Muntz, R. (1997, January 26–29). STING: A statistical information grid approach to spatial data mining. Proceedings of the VLDB, Athens, Greece.
15. Agrawal, R., Gehrke, J., Gunopulos, D., and Raghavan, P. (1998, January 2–4). Automatic subspace clustering of high dimensional data for data mining applications. Proceedings of the 1998 ACM SIGMOD international conference on Management of data, Seattle, DC, USA.10.1145/276304.276314 ↗
16. Model-based clustering, discriminant analysis, and density estimation10.1198/016214502760047131 ↗
17. A spatially explicit analysis of chronic diseases in small areas: A case study of diabetes in Santiago, Chile10.1186/s12942-020-00217-1 ↗
18. OPTICS: Ordering points to identify the clustering structure10.1145/304181.304187 ↗
19. Quickbundles, a method for tractography simplification10.3389/fnins.2012.00175 ↗
20. Choi, C., and Hong, S.-Y. (2021). Mdst-dbscan: A density-based clustering method for multidimensional spatiotemporal data. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10060391 ↗
21. Xu, X., Jäger, J., and Kriegel, H.-P. (2002). High Performance Data Mining: Scaling Algorithms, Applications and Systems, Springer.
22. Prokopenko, A., Lebrun-Grandie, D., and Arndt, D. (2023, January 7–10). Fast tree-based algorithms for DBSCAN for low-dimensional data on GPUs. Proceedings of the ICPP 2023, Salt Lake City, UT, USA.10.1145/3605573.3605594 ↗
23. DSets-DBSCAN: A parameter-free clustering algorithm10.1109/TIP.2016.2559803 ↗
24. AA-DBSCAN: An approximate adaptive DBSCAN for finding clusters with varying densities10.1007/s11227-018-2380-z ↗
25. Algorithmic research on adaptive determination of DBSCAN algorithm parameters
26. Determining the Parameters of DBSCAN Automatically Using the Multi-Objective Genetic Algorithm
27. Li, Y. (2017). Deep reinforcement learning: An overview. arXiv.
28. Deep learning10.1038/nature14539 ↗
29. Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press.
30. Reinforced, incremental and cross-lingual event detection from social messages10.1109/TPAMI.2022.3144993 ↗
31. Zhang, R., Peng, H., Dou, Y., Wu, J., Sun, Q., Li, Y., Zhang, J., and Yu, P.S. (2022, January 16). Automating DBSCAN via deep reinforcement learning. Proceedings of the CIKM 2022, Atlanta, GA, USA.10.1145/3511808.3557245 ↗
32. Fujimoto, S., Hoof, H., and Meger, D. (2018, January 10–15). Addressing function approximation error in actor-critic methods. Proceedings of the ICML 2018, Stockholmsmässan, Stockholm, Sweden.
33. Haarnoja, T., Zhou, A., Hartikainen, K., Tucker, G., Ha, S., Tan, J., Kumar, V., Zhu, H., Gupta, A., and Abbeel, P. (2018). Soft actor-critic algorithms and applications. arXiv.
34. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv.
35. Schaul, T., Quan, J., Antonoglou, I., and Silver, D. (2015). Prioritized experience replay. arXiv.
36. (2023, March 16). China Offshore AIS Open Source Data. Available online: https://www.heywhale.com/mw/dataset/623b00c9ae5cf10017b18cc6/content.
37. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
38. A cluster separation measure10.1109/TPAMI.1979.4766909 ↗
39. Normalized mutual information feature selection10.1109/TNN.2008.2005601 ↗
40. Vinh, N.X., Epps, J., and Bailey, J. (2009, January 14–18). Information theoretic measures for clusterings comparison: Is a correction for chance necessary?. Proceedings of the ICML 2009, Montreal, Canada.10.1145/1553374.1553511 ↗
41. Kanervisto, A., Scheller, C., and Hautamäki, V. (2020, January 24–27). Action space shaping in deep reinforcement learning. Proceedings of the CoG 2020, Osaka, Japan.10.1109/CoG47356.2020.9231687 ↗