PMMTss: A Parallel Multi-Way Merging-Based Trajectory Similarity Search for a Million Metro Passengers
Source abstract
Abstract
Trajectory similarity search (TSS) is a common operation for spatiotemporal data analysis. However, the existing TSS methods are mainly focused on GPS trajectories produced by moving objects such as vehicles. Further, these corresponding optimization strategies cannot be directly applied in the metro scenario because the metro passenger trajectory is totally different from the GPS trajectory. To fill this gap, we systematically analyze the unique spatiotemporal characteristics of metro passenger trajectories and propose a similarity search solution named PMMTss for the metro system. The core idea of this solution has two key points: first, we design a multi-layer index based on the spatiotemporal feature of metro trajectories, and all points of a trajectory are stored in this index. Second, we design a parallel multi-way merging-based trajectory similar search method, in which the candidate trajectory segments are merged and filtered. We evaluate this solution on a large dataset (Shenzhen Metro data for 3 consecutive months, 6.976 million trajectories with 260 million records). When lengths of input trajectories are 16, 32, and 64, respectively, the corresponding search times are 0.004 s, 0.016 s, and 0.036 s, respectively. Compared to the baseline PPJion+, the query times are reduced by 99.7%, 98.8%, and 97.6%, respectively.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Management and Algorithms · Human Mobility and Location-Based Analysis · Traffic Prediction and Management Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information, Yunnan Normal University, Kunming 650500, China
Funding
National Natural Science Foundation of China (NSFC)
References (27)
Show source-provided references
1. Tang, L., Zhao, Y., Tsui, K.L., He, Y., and Pan, L. (2020). A Clustering Refinement Approach for Revealing Urban Spatial Structure from Smart Card Data. Appl. Sci., 10.10.3390/app10165606 ↗
2. Application of Graph Theory to Mining the Similarity of Travel Trajectories10.1016/j.tourman.2021.104391 ↗
3. Lee, M., Jeon, I., and Jun, C. (2022). A Deterministic Methodology Using Smart Card Data for Prediction of Ridership on Public Transport. Appl. Sci., 12.10.3390/app12083867 ↗
4. Alarabi, L. (2018, January 6–9). Summit: A Scalable System for Massive Trajectory Data Management. Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Seattle, WA, USA.10.1145/3274895.3282795 ↗
5. Efficient Similarity Joins for Near-Duplicate Detection
6. String Similarity Joins: An Experimental Evaluation10.14778/2732296.2732299 ↗
7. GLTC: A Metro Passenger Identification Method Across AFC Data and Sparse WiFi Data10.1109/TITS.2022.3171332 ↗
8. Measuring Similarity between Any Pair of Passengers Using Smart Card Usage Data10.1109/JIOT.2021.3089624 ↗
9. Koren, Y. (2008, January 24–27). Factorization Meets the Neighborhood: A Multifaceted Collaborative Filtering Model. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, NV, USA.10.1145/1401890.1401944 ↗
10. Wu, F., Zheng, C., Zhang, C., Ma, J., and Sun, K. (2023). Multi-View Multi-Attention Graph Neural Network for Traffic Flow Forecasting. Appl. Sci., 13.10.3390/app13020711 ↗
11. Yang, P., Wang, H., Zhang, Y., Qin, L., Zhang, W., and Lin, X. (2021, January 19–23). T3S: Effective Representation Learning for Trajectory Similarity Computation. Proceedings of the 2021 IEEE 37th International Conference on Data Engineering (ICDE), Chania, Greece.10.1109/ICDE51399.2021.00221 ↗
12. Zheng, B., Weng, L., Zhao, X., Zeng, K., Zhou, X., and Jensen, C.S. (2021, January 19–23). REPOSE: Distributed Top-k Trajectory Similarity Search with Local Reference Point Tries. Proceedings of the 2021 IEEE 37th International Conference on Data Engineering (ICDE), Chania, Greece.10.1109/ICDE51399.2021.00067 ↗
13. Bitmap Filter: Speeding up Exact Set Similarity Joins with Bitwise Operations10.1016/j.is.2019.101449 ↗
14. Distributed Subtrajectory Join on Massive Datasets
15. Design and Implementation of Trajectory Data Management and Analysis Technology Framework Based on Spatiotemporal Grid Model10.5194/isprs-archives-XLIII-B4-2020-471-2020 ↗
16. Similarity Joins for High-Dimensional Data Using Spark10.1002/cpe.5339 ↗
17. Ding, J., Fang, J., Zhang, Z., Zhao, P., Xu, J., and Zhao, L. (2019, January 10–12). Real-Time Trajectory Similarity Processing Using Longest Common Subsequence. Proceedings of the 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Zhangjiajie, China.10.1109/HPCC/SmartCity/DSS.2019.00194 ↗
18. Parallel Trajectory Similarity Joins in Spatial Networks10.1007/s00778-018-0502-0 ↗
19. Distributed Trajectory Similarity Search10.14778/3137628.3137655 ↗
20. Signature-Based Trajectory Similarity Join10.1109/TKDE.2017.2651821 ↗
21. Belhassena, A., and Wang, H. (2017, January 12–14). Distributed Skyline Trajectory Query Processing. Proceedings of the ACM Turing 50th Celebration Conference, Shanghai, China.10.1145/3063955.3063974 ↗
22. Leal, E., Gruenwald, L., Zhang, J., and You, S. (2016, January 5–8). Towards an Efficient Top-k Trajectory Similarity Query Processing Algorithm for Big Trajectory Data on Gpgpus. Proceedings of the 2016 IEEE International Congress on Big Data (BigData Congress), Washington, DC, USA.10.1109/BigDataCongress.2016.33 ↗
23. Chen, L., Shang, S., Jensen, C.S., Yao, B., and Kalnis, P. (2020, January 20–24). Parallel Semantic Trajectory Similarity Join. Proceedings of the 2020 IEEE 36th International Conference on Data Engineering (ICDE), Dallas, TX, USA.10.1109/ICDE48307.2020.00091 ↗
24. Wu, J., Zhang, Y., Wang, J., Lin, C., Fu, Y., and Xing, C. (2019, January 8–11). Scalable Metric Similarity Join Using Mapreduce. Proceedings of the 2019 IEEE 35th International Conference on Data Engineering (ICDE), Macau, China.10.1109/ICDE.2019.00167 ↗
25. Theobald, M., Siddharth, J., and Paepcke, A. (2008, January 20–24). Spotsigs: Robust and Efficient near Duplicate Detection in Large Web Collections. Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Singapore.10.1145/1390334.1390431 ↗
26. Algorithms for the Longest Common Subsequence Problem10.1145/322033.322044 ↗
27. Multi-Graph Convolutional-Recurrent Neural Network (MGC-RNN) for Short-Term Forecasting of Transit Passenger Flow10.1109/TITS.2022.3150600 ↗