Dual Clustering-Based Method for Geospatial Knowledge Graph Partitioning
Source abstract
Abstract
Geospatial knowledge graphs provide critical technology for integrating geographic information and semantic knowledge, which are very useful for geographic data analysis. As the scale of geospatial knowledge graphs continues to grow, the distributed management of geospatial knowledge graphs is becoming an inevitable requirement. Geospatial knowledge graph partitioning is the core technology for the distributed management of geospatial knowledge graphs. To support geographic data analysis, spatial relationships between entities should be considered in the application of geospatial knowledge graphs. However, existing knowledge graph partitioning methods overlook the spatial relationships between entities, resulting in the low efficiency of spatial queries. To address this issue, this study proposes a geospatial knowledge graph partitioning method based on dual clustering which performs two different clustering methods step by step. First, the density peak clustering method (DPC) is used to cluster geographic nodes. The nodes within each cluster are merged into a super-node. Then, we use an efficient graph clustering method (i.e., Leiden) to identify the community structure of the graph. Nodes belonging to the same community are further merged to reduce the size of the graph. Finally, partitioning operations are performed on the compressed graph based on the idea of the Linear-Weighted Deterministic Greedy Policy (LDG). We construct a geospatial knowledge graph based on YAGO3 to evaluate the performance of the proposed graph partitioning method. The experimental results show that the proposed method outperforms ten comparison methods in terms of graph partitioning quality and spatial query efficiency.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Graph Theory and Algorithms · Data Management and Algorithms · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Geosciences and Info-Physics, Central South University, Changsha 410083, China
Guizhou Survey & Design Research Institute for Water Resources and Hydropower, Guiyang 550002, China
Funding
National Key Research and Development Program of China · National Natural Science Foundation of China · water conservancy science and technology project of Guizhou, China · Research Foundation of the Department of Natural Resources of Hunan Province
References (58)
Show source-provided references
1. A geospatial knowledge graph prototype for national topographic mapping10.5194/isprs-archives-XLVIII-4-W1-2022-511-2022 ↗
2. Dsouza, A., Tempelmeier, N., Yu, R., Gottschalk, S., and Demidova, E. (2021, January 1–5). Worldkg: A world-scale geographic knowledge graph. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Queensland, Australia.10.1145/3459637.3482023 ↗
3. Auer, S., Lehmann, J., and Hellmann, S. (2009, January 25–29). Linkedgeodata: Adding a spatial dimension to the web of data. Proceedings of the Semantic Web-ISWC 2009: 8th International Semantic Web Conference, ISWC 2009, Chantilly, VA, USA. Proceedings 8.
4. Giunchiglia, F., Maltese, V., Farazi, F., and Dutta, B. (June, January 30). GeoWordNet: A resource for geo-spatial applications. Proceedings of the Semantic Web: Research and Applications: 7th Extended Semantic Web Conference, ESWC 2010, Heraklion, Greece. Proceedings, Part I 7.10.1007/978-3-642-13486-9_9 ↗
5. A dual-store structure for knowledge graphs
6. Scalable graph processing frameworks: A taxonomy and open challenges10.1145/3199523 ↗
7. A distributed algorithm for large-scale graph partitioning10.1145/2714568 ↗
8. Some simplified NP-complete problems10.1016/0304-3975(76)90059-1 ↗
9. Survey of spectral clustering based on graph theory10.1016/j.patcog.2024.110366 ↗
10. Efficient triangle counting in large graphs via degree-based vertex partitioning10.1080/15427951.2012.625260 ↗
11. A review on graph based segmentation10.5815/ijigsp.2012.05.01 ↗
12. Stanton, I., and Kliot, G. (2012, January 12–16). Streaming graph partitioning for large distributed graphs. Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Beijing, China.10.1145/2339530.2339722 ↗
13. Malewicz, G., Austern, M.H., Bik, A.J., Dehnert, J.C., Horn, I., Leiser, N., and Czajkowski, G. (2010, January 6–10). Pregel: A system for large-scale graph processing. Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, Indianapolis, IN, USA.10.1145/1807167.1807184 ↗
14. Xie, C., Yan, L., Li, W.J., and Zhang, Z. (2014, January 8–13). Distributed power-law graph computing: Theoretical and empirical analysis. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
15. Gonzalez, J.E., Low, Y., Gu, H., Bickson, D., and Guestrin, C. (2012, January 8–10). PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs. Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, Hollywood, CA, USA.
16. Tsourakakis, C., Gkantsidis, C., Radunovic, B., and Vojnovic, M. (2014, January 24–28). FENNEL: Streaming graph partitioning for massive scale graphs. Proceedings of the 7th ACM International Conference on Web Search and Data Mining, New York, NY, USA.10.1145/2556195.2556213 ↗
17. Petroni, F., Querzoni, L., Daudjee, K., Kamali, S., and Iacoboni, G. (2015, January 7–12). HDRF: Stream-based partitioning for power-law graphs. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.10.1145/2806416.2806424 ↗
18. Play like a vertex: A stackelberg game approach for streaming graph partitioning10.1145/3654965 ↗
19. Mayer, C., Mayer, R., Tariq, M.A., Geppert, H., Laich, L., Rieger, L., and Rothermel, K. (2018, January 2–6). ADWISE: Adaptive window-based streaming edge partitioning for high-speed graph processing. Proceedings of the 38th IEEE International Conference on Distributed Computing Systems (ICDCS), Vienna, Austria.10.1109/ICDCS.2018.00072 ↗
20. Patwary, M.A.K., Garg, S., and Kang, B. (2019, January 29–31). Window-based streaming graph partitioning algorithm. Proceedings of the Australasian Computer Science Week Multiconference, Sydney, NSW, Australia.10.1145/3290688.3290711 ↗
21. Li, Y., Li, C., Orgerie, A.C., and Parvédy, P.R. (2021, January 10–13). WSGP: A window-based streaming graph partitioning approach. Proceedings of the 21st IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, Melbourne, Australia.10.1109/CCGrid51090.2021.00068 ↗
22. Buffered streaming graph partitioning10.1145/3546911 ↗
23. Wang, Z., Yang, Z., Wang, N., Du, Y., Nie, J., Wei, Z., and Yu, G. (2023, January 18–21). Lightweight streaming graph partitioning by fully utilizing knowledge from local view. Proceedings of the 43rd International Conference on Distributed Computing Systems, Hong Kong, China.10.1109/ICDCS57875.2023.00079 ↗
24. Algebraic connectivity of graphs10.21136/CMJ.1973.101168 ↗
25. Karypis, G., and Kumar, V. (1995, January 8). Analysis of multilevel graph partitioning. Proceedings of the 1995 ACM/IEEE Conference on Supercomputing, San Diego, CA, USA.10.1145/224170.224229 ↗
26. A fast and high quality multilevel scheme for partitioning irregular graphs10.1137/S1064827595287997 ↗
27. Holtgrewe, M., Sanders, P., and Schulz, C. (2010, January 19–23). Engineering a scalable high-quality graph partitioner. Proceedings of the 2010 IEEE International Symposium on Parallel & Distributed Processing, Atlanta, GA, USA.10.1109/IPDPS.2010.5470485 ↗
28. Sanders, P., and Schulz, C. (2011, January 5–9). Engineering multilevel graph partitioning algorithms. Proceedings of the 19th Annual European Symposium on Algorithms, Saarbrücken, Germany.
29. Sanders, P., and Schulz, C. (2012, January 16). Distributed evolutionary graph partitioning. Proceedings of the 14th Workshop on Algorithm Engineering and Experiments, Kyoto, Japan.10.1137/1.9781611972924.2 ↗
30. Parallel graph partitioning for complex networks10.1109/TPDS.2017.2671868 ↗
31. Fast shared-memory streaming multilevel graph partitioning10.1016/j.jpdc.2020.09.004 ↗
32. Chan, P.K., Schlag, M.D.F., and Zien, J.Y. (1993, January 14–18). Spectral k-way ratio-cut partitioning and clustering. Proceedings of the 30th International Design Automation Conference, Dallas, TX, USA.10.1145/157485.165117 ↗
33. An efficient heuristic procedure for partitioning graphs10.1002/j.1538-7305.1970.tb01770.x ↗
34. Predari, M., and Esnard, A. (2016, January 17–19). A k-way greedy graph partitioning with initial fixed vertices for parallel applications. Proceedings of the 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing, Heraklion, Greece.10.1109/PDP.2016.109 ↗
35. Fiduccia, C.M., and Mattheyses, R.M. (1982, January 14–16). A linear-time heuristic for improving network partitions. Proceedings of the 19th Design Automation Conference, Las Vegas, NV, USA.10.1109/DAC.1982.1585498 ↗
36. Rahimian, F., Payberah, A.H., Girdzijauskas, S., and Haridi, S. (2014, January 3–6). Distributed vertex-cut partitioning. Proceedings of the 14th IFIP International Conference on Distributed Applications and Interoperable System, Berlin, Germany.10.1007/978-3-662-43352-2_15 ↗
37. Li, H., Yuan, H., Huang, J., Cui, J., and Yoo, J. (2020, January 24–27). Dynamic graph repartitioning: From single vertex to vertex group. Proceedings of the 25th International Conference on Database Systems for Advanced Applications, Jeju, Republic of Korea.10.1007/978-3-030-59416-9_29 ↗
38. An improved hill climbing algorithm for graph partitioning10.1093/comjnl/bxac039 ↗
39. Graph: Traffic-aware graph processing10.1109/TPDS.2018.2794989 ↗
40. Edge repartitioning via structure-aware group migration10.1109/TCSS.2021.3090373 ↗
41. Group reassignment for dynamic edge partitioning10.1109/TPDS.2021.3069292 ↗
42. Ugander, J., and Backstrom, L. (2013, January 4–8). Balanced label propagation for partitioning massive graphs. Proceedings of the 6th ACM International Conference on Web Search and Data Mining, Rome, Italy.10.1145/2433396.2433461 ↗
43. Vaquero, L., Cuadrado, F., Logothetis, D., and Martella, C. (2014, January 3–5). Adaptive partitioning for large-scale dynamic graphs. Proceedings of the 4th Annual Symposium on Cloud Computing, Sydney, Australia.10.1145/2523616.2525943 ↗
44. Martella, C., Logothetis, D., Loukas, A., and Siganos, G. (2017, January 19–22). Spinner: Scalable graph partitioning in the cloud. Proceedings of the 33rd IEEE International Conference on Data Engineering, San Diego, CA, USA.10.1109/ICDE.2017.153 ↗
45. Slota, G.M., Rajamanickam, S., and Madduri, K. (2017). PuLP/XtraPuLP: Partitioning Tools for Extreme-Scale Graphs, Sandia National Lab. (SNL-NM). Technical report.
46. Moussawi, A.E., Seghouani, N.B., and Bugiotti, F. (2020, January 14–17). A graph partitioning algorithm for edge or vertex balance. Proceedings of the 31st International Conference on Database and Expert Systems Applications, Bratislava, Slovakia.10.1007/978-3-030-59003-1_2 ↗
47. Zhang, C., Wei, F., Liu, Q., Tang, Z.G., and Li, Z. (2017, January 13–17). Graph edge partitioning via neighborhood heuristic. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098033 ↗
48. Distributed edge partitioning for trillion-edge graphs10.14778/3358701.3358706 ↗
49. Lee, K., Ganti, R.K., Srivatsa, M., and Liu, L. (2014, January 4–7). Efficient spatial query processing for big data. Proceedings of the 22nd ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Dallas, TX, USA.10.1145/2666310.2666481 ↗
50. Efficient distance join query processing in distributed spatial data management systems10.1016/j.ins.2019.10.030 ↗
51. Zhong, Y., Han, J., Zhang, T., Li, Z., Fang, J., and Chen, G. (2012, January 21–25). Towards parallel spatial query processing for big spatial data. Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum, Shanghai, China.10.1109/IPDPSW.2012.245 ↗
52. Clustering by fast search and find of density peaks10.1126/science.1242072 ↗
53. Study on density peaks clustering based on k-nearest neighbors and principal component analysis10.1016/j.knosys.2016.02.001 ↗
54. Density-peak-based overlapping community detection algorithm10.1109/TCSS.2021.3122018 ↗
55. Traag, V.A., Waltman, L., and Van Eck, N.J. (2019). From Louvain to Leiden: Guaranteeing well-connected communities. Sci. Rep., 9.10.1038/s41598-019-41695-z ↗
56. Fast unfolding of communities in large networks10.1088/1742-5468/2008/10/P10008 ↗
57. Comparison between Louvain and Leiden algorithm for network structure: A review10.1088/1742-6596/2129/1/012028 ↗
58. Mahdisoltani, F., Biega, J., and Suchanek, F.M. (2013, January 6–9). Yago3: A knowledge base from multilingual Wikipedias. Proceedings of the 7th Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA.