journal article·2024-05-25Open access

Graph Stream Compression Scheme Based on Pattern Dictionary Using Provenance

Hyeonbyeong Lee, Bokyoung Shin, Dojin Choi, Jongtae Lim, Kyoungsoo Bok, Jaesoo Yoo

Applied Sciences· Volume 14· Issue 11

Abstract

With recent advancements in network technology and the increasing popularity of the internet, the use of social network services and Internet of Things devices has flourished, leading to a continuous generation of large volumes of graph stream data, where changes, such as additions or deletions of vertices and edges, occur over time. Additionally, owing to the need for the efficient use of storage space and security requirements, graph stream data compression has become essential in various applications. Even though various studies on graph compression methods have been conducted, most of them do not fully reflect the dynamic characteristics of graph streams and the complexity of large graphs. In this paper, we propose a compression scheme using provenance data to efficiently process and analyze large graph stream data. It obtains provenance data by analyzing graph stream data and builds a pattern dictionary based on this to perform dictionary-based compression. By improving the existing dictionary-based graph compression methods, it enables more efficient dictionary management through tracking pattern changes and evaluating their importance using provenance. Furthermore, it considers the relationships among sub-patterns using an FP-tree and performs pattern dictionary management that updates pattern scores based on time. Our experiments show that the proposed scheme outperforms existing graph compression methods in key performance metrics, such as compression rate and processing time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Graph Theory and Algorithms · Data Mining Algorithms and Applications · Web Data Mining and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information and Communication Engineering, Chungbuk National University, Chung-dae-ro 1, Seowon-gu, Cheongju 28644, Chungcheongbuk-do, Republic of Korea

Department of Computer Engineering, Changwon National University, Changwondaehak-ro 20, Uichang-gu, Changwon-si 51140, Gyeongsangnam-do, Republic of Korea

Department of Artificial Intelligence Convergence, Wonkwang University, Iksandae 460, Iksan 54538, Jeollabuk-do, Republic of Korea

Funding

National Research Foundation of Korea (NRF) · MSIT (Ministry of Science and ICT) · Rural Development Administration

References (33)

Show source-provided references
1. Song, J., Yi, Q., Gao, H., Wang, B., and Kong, X. (2023). Exploring Prior Knowledge from Human Mobility Patterns for POI Recommendation. Appl. Sci., 13.10.3390/app13116495 ↗
2. Kouahla, Z., Benrazek, A.-E., Ferrag, M.A., Farou, B., Seridi, H., Kurulay, M., Anjum, A., and Asheralieva, A. (2021). A Survey on Big IoT Data Indexing: Potential Solutions, Recent Advancements, and Open Issues. Future Internet, 14.10.3390/fi14010019 ↗
3. Substructure Discovery Using Minimum Description Length and Background Knowledge10.1613/jair.43 ↗
4. Wang, G., Ai, J., Mo, L., Yi, X., Wu, P., Wu, X., and Kong, L. (2023). Anomaly Detection for Data from Unmanned Systems via Improved Graph Neural Networks with Attention Mechanism. Drones, 7.10.3390/drones7050326 ↗
5. Henecka, W., and Roughan, M. (2015, January 24–26). Lossy Compression of Dynamic, Weighted Graphs. Proceedings of the 2015 3rd International Conference on Future Internet of Things and Cloud, Rome, Italy.10.1109/FiCloud.2015.64 ↗
6. Shah, N., Koutra, D., Zou, T., Gallagher, B., and Faloutsos, C. (2015, January 10–13). TimeCrunch: Interpretable Dynamic Graph Summarization. Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Sydney, Australia.10.1145/2783258.2783321 ↗
7. Li, Y., Ge, M., Li, M., Li, T., and Xiang, S. (2023). CLIP-Based Adaptive Graph Attention Network for Large-Scale Unsupervised Multi-Modal Hashing Retrieval. Sensors, 23.10.3390/s23073439 ↗
8. Zhao, H., Zhang, W., Huang, M., Feng, S., and Wu, Y. (2023). A Multi-Granularity Heterogeneous Graph for Extractive Text Summarization. Electronics, 12.10.3390/electronics12102184 ↗
9. Park, Y.-J., Lee, M., Yang, G.-J., Park, S.J., and Sohn, C.-B. (2023). Web Interface of NER and RE with BERT for Biomedical Text Mining. Appl. Sci., 13.10.3390/app13085163 ↗
10. Frequent Subgraph Discovery in Large Attributed Streaming Graphs
11. Packer, C.A., and Holder, L.B. (2017, January 14). GraphZip: Dictionary-Based Compression for Mining Graph Streams. Proceedings of the SIGKDD Workshop on Mining and Learning in Graphs (MLG), Halifax, NS, Canada.
12. Leung, C.K., and Khan, Q.I. (2006, January 18–22). DSTree: A Tree Structure for the Mining of Frequent Sets from Data Streams. Proceedings of the Sixth International Conference on Data Mining (ICDM’06), Hong Kong, China.10.1109/ICDM.2006.62 ↗
13. StarZIP: Streaming Graph Compression Technique for Data Archiving10.1109/ACCESS.2019.2899921 ↗
14. Mining Frequent Patterns in Data Streams at Multiple Time Granularities
15. Guo, J., Zhang, P., Tan, J., and Guo, L. (2011, January 24–28). Mining Frequent Patterns across Multiple Data Streams. Proceedings of the 20th ACM International Conference on Information and Knowledge Management, Glasgow, UK.10.1145/2063576.2063957 ↗
16. Zarrouk, M., and Gouider, M. (2012). Frequent Patterns Mining in Time-Sensitive Data Stream. Int. J. Comput. Sci. Issues, 9.
17. Zhong, H., Wang, M., and Zhang, X. (2023). Unsupervised Embedding Learning for Large-Scale Heterogeneous Networks Based on Metapath Graph Sampling. Entropy, 25.10.3390/e25020297 ↗
18. Grammar-Based Graph Compression10.1016/j.is.2018.03.002 ↗
19. Graph Stream Sketch: Summarizing Graph Streams with High Speed and Accuracy10.1109/TKDE.2022.3174570 ↗
20. SlashBurn: Graph Compression and Mining beyond Caveman Communities10.1109/TKDE.2014.2320716 ↗
21. Jalil, Z., Nasir, M., Alazab, M., Nasir, J., Amjad, T., and Alqammaz, A. (2023). Grapharizer: A Graph-Based Technique for Extractive Multi-Document Summarization. Electronics, 12.10.3390/electronics12081895 ↗
22. GraphZIP: A Clique-Based Sparse Graph Compression Method10.1186/s40537-018-0121-z ↗
23. A (Sub)Graph Isomorphism Algorithm for Matching Large Graphs10.1109/TPAMI.2004.75 ↗
24. Fournier-Viger, P., Gan, W., Wu, Y., Nouioua, M., Song, W., Truong, T., and Duong, H. (2022). Database Systems for Advanced Applications, Proceedings of the DASFAA 2022 International Workshops: BDMS, BDQM, GDMA, IWBT, MAQTDS, and PMBD, Virtual Event, 11–14 April 2022, Springer.
25. A Rule-Based Approach for Mining Creative Thinking Patterns from Big Educational Data10.3390/appliedmath3010014 ↗
26. Jamshidi, K., Mahadasa, R., and Vora, K. (2020, January 27–30). Peregrine: A Pattern-Aware Graph Mining System. Proceedings of the Fifteenth European Conference on Computer Systems, Heraklion, Greece.10.1145/3342195.3387548 ↗
27. Ketkar, N.S., Holder, L.B., and Cook, D.J. (2005, January 21). Subdue: Compression-Based Frequent Pattern Discovery in Graph Data. Proceedings of the 1st International Workshop on Open Source Data Mining: Frequent Pattern Mining Implementations, Chicago, IL, USA.10.1145/1133905.1133915 ↗
28. GraMi: Frequent Subgraph and Pattern Mining in a Single Large Graph10.14778/2732286.2732289 ↗
29. Provenance Compression Scheme Based on Graph Patterns for Large RDF Documents10.1007/s11227-019-02926-2 ↗
30. Bok, K., Jeong, J., Choi, D., and Yoo, J. (2018). Detecting Incremental Frequent Subgraph Patterns in IoT Environments. Sensors, 18.10.3390/s18114020 ↗
31. Bok, K., Kim, G., Lim, J., and Yoo, J. (2020). Historical Graph Management in Dynamic Environments. Electronics, 9.10.3390/electronics9060895 ↗
32. Han, J., Pei, J., and Yin, Y. (2000, January 15–18). Mining Frequent Patterns without Candidate Generation. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335372 ↗
33. Borgelt, C. (2005, January 21). An Implementation of the FP-Growth Algorithm. Proceedings of the 1st International Workshop on Open Source Data Mining: Frequent Pattern Mining Implementations, Chicago IL, USA.10.1145/1133905.1133907 ↗