journal article·2026-04-19Open access

DMAR: Dynamic Multi-Anchor Retrieval with Structure-Aware Query Reformulation for Knowledge-Augmented Generation

Zhou Lei, Yanqi Xu, Shengbo Chen

Applied Sciences· Volume 16· Issue 8

Abstract

Retrieval-Augmented Generation (RAG) has become an important paradigm for knowledge-intensive natural language processing, as it enables Large Language Models (LLMs) to access external evidence beyond their parametric memory. However, existing RAG pipelines often rely on static user queries and predominantly semantic matching, which makes them less effective in data-intensive scenarios that require structured knowledge and multi-hop evidence aggregation. To address these limitations, we propose DMAR, a dynamic multi-anchor retrieval framework for retrieval refinement in knowledge-augmented generation. DMAR first identifies high-confidence anchor documents from an initial candidate pool through a dual-path evaluator that combines semantic relevance with knowledge-graph-based structural association. The selected anchors are then used to guide generative query reformulation, producing an enriched query for second-stage retrieval, followed by fidelity-controlled reranking to preserve alignment with the user’s original intent. We further model structural relevance using Subgraph Shapley Values and a learnable Siamese GNN-based similarity module. Experiments on five knowledge-intensive benchmarks, covering open-domain question answering, multi-hop reasoning, and fact verification, show that DMAR consistently improves retrieval and downstream answer quality over strong baselines. For example, DMAR achieves an F1 score of 62.5% on HotpotQA and 79.0% on TriviaQA. These results demonstrate that dynamically integrating semantic retrieval, structural knowledge, and query reformulation is an effective approach for robust knowledge-augmented NLP systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Advanced Graph Neural Networks · Information Retrieval and Search Behavior

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China

Funding

Ministry of Education industry–university cooperative education project · Shanghai University

References (42)

Show source-provided references
1. Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., and Askell, A. (2020, January 6–12). Language models are few-shot learners. Proceedings of the Advances in Neural Information Processing Systems, Red Hook, NY, USA. NIPS’ 20.
2. Survey of Hallucination in Natural Language Generation10.1145/3571730 ↗
3. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions10.1145/3703155 ↗
4. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.t., and Rocktäschel, T. (2020, January 6–12). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Proceedings of the Advances in Neural Information Processing Systems, Red Hook, NY, USA.
5. Redman, T.C. (2001). Data Quality: The Field Guide, Elsevier Science. Data management Series.
6. Yoran, O., Wolfson, T., Ram, O., and Berant, J. (2024, January 7–11). Making Retrieval-Augmented Language Models Robust to Irrelevant Context. Proceedings of the 12th International Conference on Learning Representations, Vienna, Austria. OpenReview.net.
7. Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., and Yih, W. (2020, January 16–20). Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online.10.18653/v1/2020.emnlp-main.550 ↗
8. Sciavolino, C., Zhong, Z., Lee, J., and Chen, D. (2021, January 7–11). Simple Entity-Centric Questions Challenge Dense Retrievers. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.496 ↗
9. Gao, L., Ma, X., Lin, J., and Callan, J. (2023, January 4–9). Precise Zero-Shot Dense Retrieval without Relevance Labels. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Toronto, ON, Canada.10.18653/v1/2023.acl-long.99 ↗
10. Jagerman, R., Zhuang, H., Qin, Z., Wang, X., and Bendersky, M. (2023). Query Expansion by Prompting Large Language Models. arXiv.
11. Jiang, Z., Xu, F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., and Neubig, G. (2023, January 6–10). Active Retrieval Augmented Generation. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.10.18653/v1/2023.emnlp-main.495 ↗
12. How Can We Know What Language Models Know?10.1162/tacl_a_00324 ↗
13. Xu, Y., He, S., Chen, J., Wang, Z., Song, Y., Tong, H., Liu, G., Zhao, J., and Liu, K. (2024, January 12–16). Generate-on-Graph: Treat LLM as both Agent and KG for Incomplete Knowledge Graph Question Answering. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.10.18653/v1/2024.emnlp-main.1023 ↗
14. Zhou, T., Chen, Y., Liu, K., and Zhao, J. (2024, January 11–16). CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, (Volume 3: System Demonstrations), Bangkok, Thailand.10.18653/v1/2024.acl-demos.35 ↗
15. Asai, A., Wu, Z., Wang, Y., Sil, A., and Hajishirzi, H. (2024, January 7–11). Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection. Proceedings of the International Conference on Learning Representations, Vienna, Austria.
16. Opoku, D.O., Sheng, M., and Zhang, Y. DO-RAG: A Domain-Specific QA Framework Using Knowledge Graph-Enhanced Retrieval-Augmented Generation. arXiv.
17. Sawarkar, K., Mangal, A., and Solanki, S.R. (2024, January 7–9). Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers. Proceedings of the 7th IEEE International Conference on Multimedia Information Processing and Retrieval, San Jose, CA, USA.10.1109/MIPR62202.2024.00031 ↗
18. Li, Z., Wang, J., Jiang, Z., Mao, H., Chen, Z., Du, J., Zhang, Y., Zhang, F., Zhang, D., and Liu, Y. (2024). DMQR-RAG: Diverse Multi-Query Rewriting for RAG. arXiv.
19. Ma, X., Gong, Y., He, P., Zhao, H., and Duan, N. (2023, January 6–10). Query Rewriting in Retrieval-Augmented Large Language Models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.10.18653/v1/2023.emnlp-main.322 ↗
20. Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., and Wang, P. (2020). K-BERT: Enabling Language Representation with Knowledge Graph. Proceedings of the 32nd Innovative Applications of Artificial Intelligence Conference, AAAI Press.10.1609/aaai.v34i03.5681 ↗
21. KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation10.1162/tacl_a_00360 ↗
22. Baek, J., Aji, A.F., and Saffari, A. (2023, January 13). Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question Answering. Proceedings of the 1st Workshop on Natural Language Reasoning and Structured Explanations, Toronto, ON, Canada.10.18653/v1/2023.nlrse-1.7 ↗
23. Liu, Z., Xiong, C., Sun, M., and Liu, Z. (2018, January 15–20). Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrieval. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1223 ↗
24. Wang, X., Wang, Z., Gao, X., Zhang, F., Wu, Y., Xu, Z., Shi, T., Wang, Z., Li, S., and Qian, Q. (2024, January 12–16). Searching for Best Practices in Retrieval-Augmented Generation. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.10.18653/v1/2024.emnlp-main.981 ↗
25. Nogueira, R., and Cho, K. (2020). Passage Re-ranking with BERT. arXiv.
26. Song, J., Jin, C., Zhao, W., McCallum, A., and Lee, J. (2024, January 12–16). Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.10.18653/v1/2024.emnlp-main.1242 ↗
27. Yu, Y., Ping, W., Liu, Z., Wang, B., You, J., Zhang, C., Shoeybi, M., and Catanzaro, B. (2024, January 10–15). RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
28. Relevance weighting of search terms10.1002/asi.4630270302 ↗
29. Harman, D.K. (1994). Okapi at TREC-3. Proceedings of the 3rd Text REtrieval Conference, National Institute of Standards and Technology (NIST). NIST Special Publication.
30. Gao, T., Yao, X., and Chen, D. (2021, January 7–11). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.552 ↗
31. A value for n-person games
32. Exploring the limits of transfer learning with a unified text-to-text transformer
33. Natural Questions: A Benchmark for Question Answering Research
34. Joshi, M., Choi, E., Weld, D., and Zettlemoyer, L. (August, January 30). TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, (Volume 1: Long Papers), Vancouver, BC, Canada.
35. Berant, J., Chou, A., Frostig, R., and Liang, P. (2013, January 18–21). Semantic Parsing on Freebase from Question-Answer Pairs. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, DC, USA.10.18653/v1/D13-1160 ↗
36. Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., and Manning, C.D. (November, January 31). HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.10.18653/v1/D18-1259 ↗
37. Thorne, J., Vlachos, A., Christodoulopoulos, C., and Mittal, A. (2018, January 1–6). FEVER: A Large-scale Dataset for Fact Extraction and VERification. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, LA, USA.10.18653/v1/N18-1074 ↗
38. Yang, A., Yang, B., Hui, B., Zheng, B., Yu, B., Zhou, C., Li, C., Li, C., Liu, D., and Huang, F. (2024). Qwen2 Technical Report. arXiv.
39. Wikidata: A free collaborative knowledgebase10.1145/2629489 ↗
40. Douze, M., Guzhva, A., Deng, C., Johnson, J., Szilvasy, G., Mazaré, P., Lomeli, M., Hosseini, L., and Jégou, H. (2024). The Faiss library. arXiv.
41. Inductive Representation Learning on Large Graphs
42. Rumelhart, D.E., McClelland, J.L., and Group, P.R. (1986). Parallel Distributed Processing, Volume 1: Explorations in the Microstructure of Cognition: Foundations, The MIT Press.10.7551/mitpress/5236.001.0001 ↗