LLM-S2KG: LLM-Based Semantic–Structural Dual Knowledge Graph
Source abstract
Abstract
In knowledge graph construction tasks, recent research often leverages Large Language Models (LLMs) to enhance the efficiency and accuracy of unstructured data processing. However, current LLMs rely on lexical co-occurrence statistical patterns, making it difficult to capture deep semantic relationships. Furthermore, existing research largely focuses on entity-relation extraction or semantic-level optimization, overlooking the inherent hierarchical logical structures within text paragraphs (e.g., chapter organization, paragraph coherence). This leads to insufficient semantic completeness and damaged structural consistency in the constructed knowledge graphs. To address this dual limitation, we propose LLM-S2KG, a semantic–structural information extraction method that integrates LLMs with semantic correlation analysis. This method achieves synergistic modeling of semantic depth and logical structure by simultaneously performing dual parsing of keywords and structure, discovering and completing semantic associations, and finally integrating these dual graphs for construction. Experiments show that in query tasks, LLM-S2KG improved the F1 score by 0.1183, 0.1412, and 0.0231 compared with KeyBERT, TF-IDF, and LLM-KG, respectively. In fill-in-the-blank QA tasks, it achieved an accuracy of 94.81%; and in open-ended QA tasks, an accuracy of 85.885%, moderately outperforming LLM Triple Extraction (73.308%), LLM Triple Extraction with Source Sentence Augmentation (80.085%), and Chroma Database Import (76.150%). In summary, LLM-S2KG provides a unified modeling paradigm for structured knowledge extraction using LLMs, featuring mutual empowerment and co-evolution of semantics and structure.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Advanced Text Analysis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer and Mathematics, Central South University of Forestry and Technology, Changsha 410004, China
Funding
National Key Research and Development Program of China
References (59)
Show source-provided references
1. Review on Explainable Reasoning in Knowledge Graphs
2. Research Progress on Knowledge Graph Q&A Enhanced by Large Language Models
3. ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge
4. Research on Q&A Systems Integrating Knowledge Graphs and Large Language Models
5. Research on Knowledge Graph Construction and Application Based on Large Language Models
6. Semantic association effects and their neural mechanisms from the perspective of lexical co-occurrence frequency10.3724/SP.J.1042.2021.00112 ↗
7. Shen, T., Wang, J., Zhang, X., and Cambria, E. (2025, January 19–24). Reasoning with Trees: Faithful Question Answering over Knowledge Graph. Proceedings of the International Conference on Computational Linguistics (COLING), Abu Dhabi, United Arab Emirates.
8. BEKO: Bidirectional Enhancement of Large Language Models and Knowledge Graphs
9. Fellbaum, C., and Miller, G. (1998). WordNet: An Electronic Lexical Database, MIT Press.10.7551/mitpress/7287.001.0001 ↗
10. CYC: A large-scale investment in knowledge infrastructure10.1145/219717.219745 ↗
11. You, B., Liu, X.-R., Li, N., and Yan, Y.-S. (2012). Using Information Content to Evaluate Semantic Similarity on HowNet. International Conference on Computational Intelligence and Security, IEEE.
12. Liu, Y., Mao, Y., Chi, F., Wu, B., Ding, S., and Qi, R. (2024). LRIRL: Improving Knowledge Graph Reasoning through Representation Learning-Based Rule Induction. 2024 IEEE 36th International Conference on Tools with Artificial Intelligence (ICTAI), IEEE.10.1109/ICTAI62512.2024.00096 ↗
13. UIMA Ruta: Rapid development of rule-based information extraction applications10.1017/S1351324914000114 ↗
14. Wang, W.Y., Mazaitis, K., and Cohen, W.W. (2013). Programming with Personalized PageRank: A Locally Groundable First-Order Probabilistic Logic. Proceedings of the 22nd ACM International Conference on Information & Knowledge Management, Association for Computing Machinery.10.1145/2505515.2505573 ↗
15. Qu, M., Chen, J., Xhonneux, L.-P., Bengio, Y., and Tang, J. (2021, January 3–7). RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs. Proceedings of the International Conference on Learning Representations, Virtual Event.
16. A pesticide molecular generation model based on deep learning and skeletal structure MHA-RNN
17. AutoGMM-RWKV: A Detecting Scheme Based on Attention Mechanisms Against Selective Forwarding Attacks in Wireless Sensor Networks10.1109/JIOT.2024.3484999 ↗
18. Knowledge graph-based entity type completion using neighborhood aggregation and CNN
19. Event trigger word extraction method based on CNN-BiGRU model
20. Research on Chinese Event Extraction Method Based on BERT-DGCNN
21. Many-objective emergency aided decision making based on knowledge graph10.1007/s10489-024-05557-0 ↗
22. A multi-energy load forecasting method based on complementary ensemble empirical model decomposition and composite evaluation factor reconstruction10.1016/j.apenergy.2024.123283 ↗
23. Zhang, G., Xie, F., and Yu, L. (2024). MaskDGNets: Masked-attention guided dynamic graph aggregation network for event extraction. PLoS ONE, 19.10.1371/journal.pone.0306673 ↗
24. SbSER: A Large Language Model Gradually Enhanced Inference Framework Based on External Subgraph Generation
25. Jiang, G., Luo, Z., Shi, Y., Wang, D., Liang, J., and Yang, D. (2024, January 20–25). ToNER: Type-oriented Named Entity Recognition with Generative Language Model. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), Torino, Italy.10.63317/5e4626ugwvwz ↗
26. Liu, X., Liu, J., Zhu, P., and Xiang, T. (2024). MilChat: A Large Language Model and Application for Military Equipment. 2024 7th International Conference on Machine Learning and Natural Language Processing (MLNLP), IEEE.
27. Chen, W., Su, Y., Yan, X., and Wang, W.Y. (2024). KGPT: Knowledge-grounded pre-training for data-to-text generation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.
28. Ke, P., Ji, H., Ran, Y., Cui, X., Wang, L., Song, L., Zhu, X., and Huang, M. (2021). JointGT: Graph-text joint representation learning for text generation from knowledge graphs. Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, Association for Computational Linguistics.10.18653/v1/2021.findings-acl.223 ↗
29. Yasunaga, M., Bosselut, A., Ren, H., Zhang, X., Manning, C.D., Liang, P.S., and Leskovec, J. (2024). Deep bidirectional language-knowledge graph pretraining. Proceedings of the 36th International Conference on Neural Information Processing Systems, ACM Press.
30. Hofmann, V., Schuetze, H., and Pierrehumbert, J. (2022). An embarrassingly simple method to mitigate undesirable properties of pretrained language model tokenizers. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Association for Computational Linguistics.10.18653/v1/2022.acl-short.43 ↗
31. Yehezkel, S., and Pinter, Y. (2023). Incorporating context into subword vocabularies. Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, Association for Computational Linguistics.10.18653/v1/2023.eacl-main.45 ↗
32. Bauwens, T., and Delobelle, P. (2024). BPE-knockout: Pruning pre-existing BPE tokenisers with backwards-compatible morphological semi-supervision. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), Association for Computational Linguistics.10.18653/v1/2024.naacl-long.324 ↗
33. Geva, M., Bastings, J., Filippova, K., and Globerson, A. (2023). Dissecting recall of factual associations in auto-regressive language models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.10.18653/v1/2023.emnlp-main.751 ↗
34. Feucht, S., Atkinson, D., Wallace, B.C., and Bau, D. (2024). Token erasure as a footprint of implicit vocabulary items in LLMs. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.10.18653/v1/2024.emnlp-main.543 ↗
35. Retrieval-augmented generation for knowledge- intensive NLP tasks
36. In-context retrieval-augmented language models10.1162/tacl_a_00605 ↗
37. Asai, A., Wu, Z., Wang, Y., Sil, A., and Hajishirzi, H. (2024, January 7–11). Self-RAG: Learning to retrieve, generate, and critique through self-reflection. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria.
38. Zhang, X., and Wu, J. (2024, January 7–11). Dissecting learning and forgetting in language model finetuning. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria.
39. Deitke, M., Clark, C., Lee, S., Tripathi, R., Yang, Y., Park, J.S., Salehi, M., Muennighoff, N., Lo, K., and Soldaini, L. (2025, January 10–17). Molmo and pixmo: Open weights and open data for state-of-the-art vision-language models. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.10.1109/CVPR52734.2025.00018 ↗
40. Jing, C., Jia, Y., Wu, Y., Liu, X., and Wu, Q. (2022, January 18–24). Maintaining reasoning consistency in compositional visual question answering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00504 ↗
41. Czyż, P., Grabowski, F., Vogt, J.E., Beerenwinkel, N., and Marx, A. (2024, January 21). On the Properties and Estimation of Pointwise Mutual Information Profiles. Proceedings of the Sixth Symposium on Advances in Approximate Bayesian Inference-Non Archival Track, Vienna, Austria.
42. An improved model of semantic similarity based on lexical co-occurrence
43. Wikipedia bi-linear link (WBLM) model: A new approach for measuring semantic similarity and relatedness between linguistic concepts using Wikipedia link structure10.1016/j.ipm.2022.103202 ↗
44. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013, January 2–4). Efficient estimation of word representations in vector space. Proceedings of the International Conference on Learning Representations, Scottsdale, AZ, USA.
45. Indexing by latent semantic analysis10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9 ↗
46. Smith, R. (2007). An Overview of the Tesseract OCR Engine. International Conference on Document Analysis & Recognition, IEEE Computer Society.10.1109/ICDAR.2007.4376991 ↗
47. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020). Language Models are Few-Shot Learners. Proceedings of the 34th International Conference on Neural Information Processing Systems, Curran Associates Inc.
48. Sun, Z., Li, X., Sun, X., Meng, Y., Ao, X., He, Q., Wu, F., and Li, J. (2021). ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Association for Computational Linguistics.10.18653/v1/2021.acl-long.161 ↗
49. Illuminating protein space with a programmable generative model10.1038/s41586-023-06728-8 ↗
50. Creating Large Language Model Applications Utilizing LangChain
51. Du, Z., Qian, Y., Liu, X., Ding, M., Qiu, J., Yang, Z., and Tang, J. (2022). GLM: General language model pretraining with autoregressive blank infilling. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics.10.18653/v1/2022.acl-long.26 ↗
52. Sun, M., Li, J., Guo, Z., Zhao, Y., Zheng, Y., Si, X., and Liu, Z. (2025, May 09). THUCTC: An Efficient Chinese Text Classifier. Available online: http://thuctc.thunlp.org/.
53. Issa, B., Jasser, M.B., Chua, H.N., and Hamzah, M. (2012). A comparative study on embedding models for keyword extraction using KeyBERT method. 2023 IEEE 13th International Conference on System Engineering and Technology (ICSET), IEEE.10.1109/ICSET59111.2023.10295108 ↗
54. Exploring job competency related to intelligent construction in China using a text mining method10.1108/ECAM-07-2024-0846 ↗
55. Webber, J. (2012). A programmatic introduction to Neo4j. Proceedings of the 3rd Annual Conference on Systems, Programming, and Applications: Software for Humanity, Association for Computing Machinery.10.1145/2384716.2384777 ↗
56. Billion-scale similarity search with GPUs10.1109/TBDATA.2019.2921572 ↗
57. Guo, R., Sun, P., Lindgren, E., Geng, Q., Simcha, D., Chern, F., and Kumar, S. (2020, January 13–18). Accelerating large-scale inference with anisotropic vector quantization. Proceedings of the 37th International Conference on Machine Learning (ICML), Virtual.
58. Mihalcea, R., Corley, C., and Strapparava, C. (2006). Corpus-based and knowledge-based measures of text semantic similarity. Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), AAAI Press.
59. Holtzman, A., Buys, J., Du, L., Forbes, M., and Choi, Y. (2020, January 26–30). The curious case of neural text degeneration. Proceedings of the 8th International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.