Hybrid Retrieval-Augmented Generation: Semantic and Structural Integration for Large Language Model Reasoning
Source abstract
Abstract
Recent GraphRAG methods based on knowledge graphs (KGs) primarily rely on either under-reasoning or a structural path-level retriever, which prevents them from jointly capturing fine-grained semantic relevance and explicit multi-hop reasoning paths. This separation often results in semantic mismatch—where logical links are missing—or structural over-constraint in reasoning— where rigid dependencies limit flexible reasoning—thereby degrading both answer accuracy and the reliability of evidence in complex KGQA tasks. To address these issues, we propose HybRAG, a hybrid retrieval framework that synergistically integrates a semantic node-level retriever and structural path-level retriever. HybRAG constructs a hybrid subgraph that jointly reflects the semantic proximity of entities and the relational structures encoded in the KG. Furthermore, we incorporate retrieval-augmented fine-tuning, which enables the model to internalize advanced reasoning strategies for interpreting disparate semantic and structural signals, rather than merely memorizing domain facts. Through extensive experiments on the WebQSP and CWQ benchmarks, we demonstrate that HybRAG effectively bridges the gap between LLM-centric semantic approaches and GNN-centric structural approaches, outperforming single-retriever baselines. Our findings, including detailed sensitivity and ablation analyses, provide empirical evidence that the systematic alignment of semantic and structural signals is essential for ensuring the reasoning reliability and scalability of next-generation GraphRAG systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Graph Neural Networks · Topic Modeling · Multimodal Machine Learning Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea
Funding
Chungnam National University
References (41)
Show source-provided references
1. Fan, W., Ding, Y., Ning, L., Wang, S., Li, H., Yin, D., Chua, T.S., and Li, Q. (2024). A survey on rag meeting llms: Towards retrieval-augmented large language models. KDD ’24: The 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/3637528.3671470 ↗
2. Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., and Bhosale, S. (2023). Llama 2: Open foundation and fine-tuned chat models. arXiv.
3. Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., Kadian, A., Al-Dahle, A., Letman, A., Mathur, A., Schelten, A., and Vaughan, A. (2024). The llama 3 herd of models. arXiv.
4. OpenAI (2026, February 24). Introducing ChatGPT. 2022. Available online: https://openai.com/index/chatgpt/.
5. Peng, B., Zhu, Y., Liu, Y., Bo, X., Shi, H., Hong, C., Zhang, Y., and Tang, S. (2024). Graph retrieval-augmented generation: A survey. arXiv.
6. Karpukhin, V., Oguz, B., Min, S., Lewis, P.S., Wu, L., Edunov, S., Chen, D., and Yih, W.T. (2020). Dense Passage Retrieval for Open-Domain Question Answering. 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics.10.18653/v1/2020.emnlp-main.550 ↗
7. Luo, L., Li, Y., Haffari, G., and Pan, S. (2024, January 7–11). Reasoning on Graphs: Faithful and Interpretable Large language Model Reasoning. Proceedings of the International Conference on Learning Representations ICLR, Vienna, Austria.
8. Li, S., Gao, Y., Jiang, H., Yin, Q., Li, Z., Yan, X., Zhang, C., and Yin, B. (2023). Graph reasoning for question answering with triplet retrieval. Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics.10.18653/v1/2023.findings-acl.208 ↗
9. Panda, P., Agarwal, A., Devaguptapu, C., Kaul, M., and Ap, P. (2024). HOLMES: Hyper-relational knowledge graphs for multi-hop question answering using LLMs. 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.10.18653/v1/2024.acl-long.717 ↗
10. Yasunaga, M., Ren, H., Bosselut, A., Liang, P., and Leskovec, J. (2021). QA-GNN: Reasoning with language models and knowledge graphs for question answering. 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics.10.18653/v1/2021.naacl-main.45 ↗
11. Dehghan, M., Alomrani, M., Bagga, S., Alfonso-Hermelo, D., Bibi, K., Ghaddar, A., Zhang, Y., Li, X., Hao, J., and Liu, Q. (2024). EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems. 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics.10.18653/v1/2024.acl-long.764 ↗
12. Saxena, A., Tripathi, A., and Talukdar, P. (2020). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics.10.18653/v1/2020.acl-main.412 ↗
13. Wang, K., Duan, F., Wang, S., Li, P., Xian, Y., Yin, C., Rong, W., and Xiong, Z. (2023). Knowledge-driven cot: Exploring faithful reasoning in llms for knowledge-intensive question answering. arXiv.10.18293/SEKE2023-023 ↗
14. Sun, J., Xu, C., Tang, L., Wang, S., Lin, C., Gong, Y., Ni, L.M., Shum, H., and Guo, J. (2024, January 7–11). Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph. Proceedings of the International Conference on Learning Representations ICLR, Vienna, Austria.
15. G-retriever: Retrieval-augmented generation for textual graph understanding and question answering
16. Mavromatis, C., and Karypis, G. (2025). GNN-RAG: Graph Neural Retrieval for Efficient Large Language Model Reasoning on Knowledge Graphs. Findings of the Association for Computational Linguistics: ACL 2025, Association for Computational Linguistics.10.18653/v1/2025.findings-acl.856 ↗
17. Zhang, Q., Chen, S., Bei, Y., Yuan, Z., Zhou, H., Hong, Z., Dong, J., Chen, H., Chang, Y., and Huang, X. (2025). A survey of graph retrieval-augmented generation for customized large language models. arXiv.
18. Jeong, S., Choi, M., Kim, J.Y., Yoon, S., and Lim, S. (2026). Metadata Meets LLMs: Constructing Knowledge-Rich Citation Networks with CoT-Enhanced Representations. WSDM ’26:The Nineteenth ACM International Conference on Web Search and Data Mining, Association for Computing Machinery.10.1145/3773966.3779395 ↗
19. What is in the KGQA benchmark datasets? Survey on challenges in datasets for question answering on knowledge graphs10.1007/s13740-021-00128-9 ↗
20. Retrieval-augmented generation for knowledge-intensive nlp tasks
21. Guu, K., Lee, K., Tung, Z., Pasupat, P., and Chang, M. (2020). Retrieval augmented language model pre-training. 37th International Conference on Machine Learning, MLR Press.
22. Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, H., and Wang, H. (2023). Retrieval-augmented generation for large language models: A survey. arXiv.
23. Han, H., Ma, L., Shomer, H., Wang, Y., Lei, Y., Guo, K., Hua, Z., Long, B., Liu, H., and Aggarwal, C.C. (2025). Rag vs. graphrag: A systematic evaluation and key insights. arXiv.
24. Ren, X., Tang, J., Yin, D., Chawla, N., and Huang, C. (2024). A survey of large language models for graphs. KDD ’24: The 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/3637528.3671460 ↗
25. Edge, D., Trinh, H., Cheng, N., Bradley, J., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R.O., and Larson, J. (2024). From local to global: A graph rag approach to query-focused summarization. arXiv.
26. Li, Y., Zhang, X., Luo, L., Chang, H., Ren, Y., King, I., and Li, J. (2025). G-refer: Graph retrieval-augmented large language model for explainable recommendation. WWW ’25: The ACM Web Conference 2025, Association for Computing Machinery.10.1145/3696410.3714727 ↗
27. Reimers, N., and Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics.10.18653/v1/D19-1410 ↗
28. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics.
29. Mavromatis, C., and Karypis, G. (2022). ReaRev: Adaptive Reasoning for Question Answering over Knowledge Graphs. Findings of the Association for Computational Linguistics: EMNLP 2022, Association for Computational Linguistics.10.18653/v1/2022.findings-emnlp.181 ↗
30. Kipf, T.N., and Welling, M. (2017, January 24–26). Semi-supervised classification with graph convolutional networks. Proceedings of the International Conference on Learning Representations, Toulon, France.
31. Jiang, J., Zhou, K., Dong, Z., Ye, K., Zhao, W.X., and Wen, J.R. (2023). StructGPT: A General Framework for Large Language Model to Reason over Structured Data. 2023 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.10.18653/v1/2023.emnlp-main.574 ↗
32. Sui, Y., He, Y., Liu, N., He, X., Wang, K., and Hooi, B. (2025). FiDeLiS: Faithful Reasoning in Large Language Models for Knowledge Graph Question Answering. Findings of the Association for Computational Linguistics: ACL 2025, Association for Computational Linguistics.10.18653/v1/2025.findings-acl.436 ↗
33. Zhang, T., Patil, S.G., Jain, N., Shen, S., Zaharia, M., Stoica, I., and Gonzalez, J.E. (2024, January 7–9). Raft: Adapting language model to domain specific rag. Proceedings of the First Conference on Language Modeling, Pennsylvania, PA, USA.
34. Ovadia, O., Brief, M., Mishaeli, M., and Elisha, O. (2024). Fine-tuning or retrieval? comparing knowledge injection in llms. 2024 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.10.18653/v1/2024.emnlp-main.15 ↗
35. Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. (2022, January 25–29). LoRA: Low-Rank Adaptation of Large Language Models. Proceedings of the 2022 International Conference on Learning Representations, Virtual.
36. Yih, W.t., Richardson, M., Meek, C., Chang, M.W., and Suh, J. (2016). The value of semantic parse labeling for knowledge base question answering. 54th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics.10.18653/v1/P16-2033 ↗
37. Talmor, A., and Berant, J. (2018). The Web as a Knowledge-Base for Answering Complex Questions. 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics.10.18653/v1/N18-1059 ↗
38. Bollacker, K., Evans, C., Paritosh, P., Sturge, T., and Taylor, J. (2008). Freebase: A collaboratively created graph database for structuring human knowledge. SIGMOD/PODS ’08: SIGMOD/PODS ’08—International Conference on Management of Data, Association for Computing Machinery.10.1145/1376616.1376746 ↗
39. Es, S., James, J., Anke, L.E., and Schockaert, S. (2024). Ragas: Automated evaluation of retrieval augmented generation. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, Association for Computational Linguistics.10.18653/v1/2024.eacl-demo.16 ↗
40. Unifying large language models and knowledge graphs: A roadmap10.1109/TKDE.2024.3352100 ↗
41. Survey of hallucination in natural language generation10.1145/3571730 ↗