Retrieval-Augmented Generation (RAG) and Large Language Models (LLMs) for Enterprise Knowledge Management and Document Automation: A Systematic Literature Review
Source abstract
Abstract
The integration of Retrieval-Augmented Generation (RAG) with Large Language Models (LLMs) is rapidly transforming enterprise knowledge management, yet a comprehensive understanding of their deployment in real-world workflows remains limited. This study presents a systematic literature review (SLR) analyzing 63 high-quality primary studies selected after rigorous screening to evaluate how these technologies address practical enterprise challenges. We formulated nine research questions targeting platforms, datasets, algorithms, and validation metrics to map the current landscape. Our findings reveal that enterprise adoption is largely in the experimental phase: 63.6% of implementations utilize GPT based models, and 80.5% rely on standard retrieval frameworks such as FAISS or Elasticsearch. Critically, this review identifies a significant ‘lab-to-market’ gap; while retrieval and classification sub-tasks frequently employ academic validation methods like k-fold cross-validation (93.6%), generative evaluation predominantly relies on static hold-out sets due to computational constraints. Furthermore, fewer than 15% of studies address real-time integration challenges required for production scale deployment. By systematically mapping these disparities, this study offers a data-driven perspective and a strategic roadmap for bridging the gap between academic prototypes and robust enterprise applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Healthcare and Education · Topic Modeling · AI in Service Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Istanbul Kültür University, Istanbul 34158, Turkey
References (100+)
Show source-provided references
1. Mallen, A., Asai, A., Zhong, V., Das, R., Khashabi, D., and Hajishirzi, H. (2023, January 9–14). When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, ON, Canada.10.18653/v1/2023.acl-long.546 ↗
2. Lazaridou, A., Gribovskaya, E., Stokowiec, W., and Grigorev, N. (2022). Internet-augmented language models through few-shot prompting for open-domain question answering. arXiv.
3. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., and Cao, Y. (2023, January 1–5). ReAct: Synergizing Reasoning and Acting in Language Models. Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda.
4. Wang, N., Han, X., Singh, J., Ma, J., and Chaudhary, V. (2025). CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation. arXiv.10.18653/v1/2025.findings-acl.1165 ↗
5. Ma, X., Gong, Y., He, P., Zhao, H., and Duan, N. (2023, January 6–10). Query Rewriting for Retrieval-Augmented Large Language Models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore.10.18653/v1/2023.emnlp-main.322 ↗
6. PaLM: Scaling Language Modeling with Pathways
7. Khattab, O., Singhvi, A., Maheshwari, P., Zhang, Z., Santhanam, K., Vardhamanan, S., Haq, S., Sharma, A., Joshi, T.T., and Moazam, H. (2024, January 7–11). DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
8. Kandpal, N., Deng, H., Roberts, A., Wallace, E., and Raffel, C. (2023, January 23–29). Large Language Models Struggle to Learn Long-Tail Knowledge. Proceedings of the 40th International Conference on Machine Learning (ICML), Honolulu, HI, USA.
9. Driving Sustainable Energy Transitions with a Multi-Source RAG-LLM System10.1016/j.enbuild.2024.114827 ↗
10. Sun, J., Xu, C., Tang, L., Wang, S., Lin, C., Gong, Y., Ni, L.M., Shum, H.Y., and Guo, J. (2024, January 7–11). Think-on-Graph: Deep and Responsible Reasoning of Large Language Models with Knowledge Graphs. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
11. Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R.R., and Le, Q.V. (2019, January 8–14). XLNet: Generalized Autoregressive Pretraining for Language Understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada.
12. (2023). GPT-4 Technical Report. arXiv.
13. Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., and Bhosale, S. (2023). Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv.
14. Zhang, S., Roller, S., Goyal, N., Artetxe, M., Chen, M., Chen, S., Dewan, C., Diab, M., Li, X., and Lin, X.V. (2022). OPT: Open Pre-trained Transformer Language Models. arXiv.
15. Black, S., Biderman, S., Hallahan, E., Anthony, Q., Gao, L., Golding, L., He, H., Leahy, C., McDonell, K., and Phang, J. (2022, January 27). GPT-NeoX-20B: An Open-Source Autoregressive Language Model. Proceedings of the BigScience Episode #5—Workshop on Challenges & Perspectives in Creating Large Language Models, Dublin, Ireland.10.18653/v1/2022.bigscience-1.9 ↗
16. Le Scao, T., Fan, A., Akiki, C., Pavlick, E., Ilić, S., Hesslow, D., Hesslow, D., Castagné, R., Luccioni, A.S., and Yvon, F. (2022). BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. arXiv.
17. Survey of Hallucination in Natural Language Generation10.1145/3571730 ↗
18. Zhang, Y., Li, Y., Cui, L., Cai, D., Liu, L., Fu, T., Huang, X., Zhao, E., Zhang, Y., and Xu, C. (2023). Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models. arXiv.
19. Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., and Wang, H. (2023). Retrieval-Augmented Generation for Large Language Models: A Survey. arXiv.
20. Cui, L., Wu, Y., Liu, J., Yang, S., and Zhang, Y. (2021, January 1–6). Template-Based Named Entity Recognition Using BART. Proceedings of the Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, Online Event.10.18653/v1/2021.findings-acl.161 ↗
21. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2020, January 26–30). RoBERTa: A Robustly Optimized BERT Pretraining Approach. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
22. Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. (2016, January 1–5). SQuAD: 100,000+ Questions for Machine Comprehension of Text. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP), Austin, TX, USA.10.18653/v1/D16-1264 ↗
23. Chen, D., Fisch, A., Weston, J., and Bordes, A. (August, January 30). Reading Wikipedia to Answer Open-Domain Questions. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), Vancouver, BC, Canada.
24. Qu, Y., Ding, Y., Liu, J., Liu, K., Ren, R., Zhao, W.X., Dong, D., Wu, H., and Wang, H. (2021, January 6–11). RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.10.18653/v1/2021.naacl-main.466 ↗
25. Shi, W., Min, S., Yasunaga, M., Seo, M., James, R., Lewis, M., Zettlemoyer, L., and Yih, W.t. (2024, January 16–21). REPLUG: Retrieval-Augmented Black-Box Language Models. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Mexico City, Mexico.10.18653/v1/2024.naacl-long.463 ↗
26. Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., and Celikyilmaz, A. (2023). Augmented Language Models: A Survey. arXiv.
27. Sanh, V., Webson, A., Raffel, C., Bach, S.H., Sutawika, L., Alyafeai, Z., Chaffin, A., Stiegler, A., Scao, T.L., and Raja, A. (2022, January 25–29). Multitask Prompted Training Enables Zero-Shot Task Generalization. Proceedings of the International Conference on Learning Representations (ICLR), Virtually.
28. Min, S., Lewis, M., Zettlemoyer, L., and Hajishirzi, H. (2022, January 10–15). MetaICL: Learning to Learn In Context. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Seattle, WA, USA.10.18653/v1/2022.naacl-main.201 ↗
29. Xiong, L., Xiong, C., Li, Y., Tang, K.F., Liu, J., Bennett, P., Ahmed, J., and Overwijk, A. (2021, January 3–7). Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. Proceedings of the International Conference on Learning Representations (ICLR), Virtual-Only Event.
30. Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., and Zhou, D. (December, January 28). Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LA, USA.
31. Asai, A., Wu, Z., Wang, Y., Sil, A., and Hajishirzi, H. (2024, January 7–11). Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection. Proceedings of the International Conference on Learning Representations, Vienna, Austria.
32. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., and Stoyanov, V. (2020, January 5–10). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), Online.10.18653/v1/2020.acl-main.747 ↗
33. Trivedi, H., Balasubramanian, N., Khot, T., and Sabharwal, A. (2023, January 9–14). Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL), Toronto, ON, Canada.10.18653/v1/2023.acl-long.557 ↗
34. Song, K., Tan, X., Qin, T., Lu, J., and Liu, T.Y. (, January 6–12December). MPNet: Masked and Permuted Pre-training for Language Understanding. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Virtual Event.
35. Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Hambro, E., Zettlemoyer, L., Cancedda, N., and Scialom, T. (2023, January 10–16). Toolformer: Language Models Can Teach Themselves to Use Tools. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LN, USA.
36. Borgeaud, S., Mensch, A., Hoffmann, J., Cai, T., Rutherford, E., Millican, K., Van Den Driessche, G.B., Lespiau, J.B., Damoc, B., and Clark, A. (2022, January 17–23). Improving Language Models by Retrieving from Trillions of Tokens. Proceedings of the 39th International Conference on Machine Learning (ICML), Baltimore, MD, USA.
37. Luo, H., Zhang, T., Chuang, Y.S., Gong, Y., Kim, Y., Wu, X., Meng, H., and Glass, J. (2023, January 6–10). Search Augmented Instruction Learning. Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.10.18653/v1/2023.findings-emnlp.242 ↗
38. Lester, B., Al-Rfou, R., and Constant, N. (2021, January 7–11). The Power of Scale for Parameter-Efficient Prompt Tuning. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.10.18653/v1/2021.emnlp-main.243 ↗
39. Li, X.L., and Liang, P. (2021, January 1–6). Prefix-Tuning: Optimizing Continuous Prompts for Generation. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Bangkok, Thailand.10.18653/v1/2021.acl-long.353 ↗
40. Liu, X., Ji, K., Fu, Y., Tam, W., Du, Z., Yang, Z., and Tang, J. (2022, January 22–27). P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and Tasks. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Dublin, Ireland.10.18653/v1/2022.acl-short.8 ↗
41. Qin, Y., Liang, S., Ye, Y., Zhu, K., Yan, L., and Lu, Y. (2024, January 7–11). ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
42. Language Models are Unsupervised Multitask Learners
43. Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., and Gurevych, I. (2021, January 6–14). BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models. Proceedings of the Advances in Neural Information Processing Systems 34 (NeurIPS 2021), Track on Datasets and Benchmarks, Virtually.
44. Hermann, K.M., Kocisky, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., and Blunsom, P. (2015, January 7–12). Teaching Machines to Read and Comprehend. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montréal, QC, Canada.
45. Almanac: Retrieval-Augmented Language Models for Clinical Medicine10.1056/AIoa2300068 ↗
46. Natural Questions: A Benchmark for Question Answering Research
47. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
48. Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., and Zettlemoyer, L. (2020, January 5–10). BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL), Seattle, WA, USA.10.18653/v1/2020.acl-main.703 ↗
49. Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R. (2020, January 26–30). ALBERT: A Lite BERT for Self-supervised Learning of Language Representations. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
50. Wu, Y., Li, H., Wu, H.T., Tao, Z., and Fang, Y. (2024). Does RAG Introduce Unfairness in LLMs? Evaluating Fairness in Retrieval-Augmented Generation Systems. arXiv.
51. Es, S., James, J., Espinosa-Anke, L., and Schockaert, S. (2024, January 17–22). RAGAS: Automated Evaluation of Retrieval Augmented Generation. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations (EACL), St. Julian’s, Malta.10.18653/v1/2024.eacl-demo.16 ↗
52. Levine, Y., Dalmedigos, I., Ram, O., Zeldes, Y., Jannai, D., Muhlgay, D., Osin, Y., Lieber, O., Lenz, B., and Shalev-Shwartz, S. (2022). Standing on the Shoulders of Giant Frozen Language Models. arXiv.
53. Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W.W., Salakhutdinov, R., and Manning, C.D. (November, January 31). HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), Brussels, Belgium.10.18653/v1/D18-1259 ↗
54. Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.t., and Rocktäschel, T. (2020, January 6–12). Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. Proceedings of the Advances in Neural Information Processing Systems, Virtually.
55. Joshi, M., Choi, E., Weld, D.S., and Zettlemoyer, L. (August, January 30). TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), Vancouver, BC, Canada.
56. Lin, X.V., Chen, X., Chen, M., Shi, W., Lomeli, M., James, R., Rodriguez, P., Kahn, J., Szilvasy, G., and Lewis, M. (2024, January 7–11). RA-DIT: Retrieval-Augmented Dual Instruction Tuning. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
57. Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., and Cui, B. (2024). Retrieval-Augmented Generation for AI-Generated Content: A Survey. arXiv.
58. Han, B., Susnjak, T., and Mathrani, A. (2024). Automating Systematic Literature Reviews with Retrieval-Augmented Generation: A Comprehensive Overview. Appl. Sci., 14.10.3390/app14199103 ↗
59. Chen, J., Lin, H., Han, X., and Sun, L. (2024, January 20–27). Benchmarking Large Language Models in Retrieval-Augmented Generation. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.
60. Edge, D., Trinh, H., Cheng, N., Bradley, J., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R.O., and Larson, J. (2024). From Local to Global: A Graph RAG Approach to Query-Focused Summarization. arXiv.
61. Jiang, Z., Xu, F., Gao, L., Sun, Z., Liu, Q., Dwivedi-Yu, J., Yang, Y., Callan, J., and Neubig, G. (2023, January 6–10). Active Retrieval Augmented Generation. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Singapore.10.18653/v1/2023.emnlp-main.495 ↗
62. Unifying Large Language Models and Knowledge Graphs: A Roadmap10.1109/TKDE.2024.3352100 ↗
63. In-Context Retrieval-Augmented Language Models10.1162/tacl_a_00605 ↗
64. Dettmers, T., Pagnoni, A., Holtzman, A., and Zettlemoyer, L. (2023, January 10–16). QLoRA: Efficient Finetuning of Quantized LLMs. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LN, USA.
65. Saad-Falcon, J., Khattab, O., Potts, C., and Zaharia, M. (2024, January 16–21). ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systems. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), Mexico City, Mexico.10.18653/v1/2024.naacl-long.20 ↗
66. Gao, L., and Callan, J. (2022, January 22–27). Unsupervised Corpus Aware Language Model Pre-Training for Dense Passage Retrieval. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL), Dublin, Ireland.10.18653/v1/2022.acl-long.203 ↗
67. Barnett, S., Kurniawan, S., Thudumu, S., Bratanis, Z., and Lau, J.H. (2024). Seven Failure Points When Engineering a Retrieval Augmented Generation System. arXiv.10.1145/3644815.3644945 ↗
68. Lost in the Middle: How Language Models Use Long Contexts10.1162/tacl_a_00638 ↗
69. Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., and Manning, C.D. (2024, January 7–11). RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
70. Zhang, T., Patil, S.G., Jain, N., Shen, S., Zaharia, M., Stoica, I., and Gonzalez, J.E. (2024). RAFT: Adapting Language Model to Domain Specific RAG. arXiv.
71. Jiang, A.Q., Sablayrolles, A., Mensch, A., Bamford, C., Chaplot, D.S., de Las Casas, D., Bressand, F., Lengyel, G., Lample, G., and Saulnier, L. (2023). Mistral 7B. arXiv.
72. Beltagy, I., Peters, M.E., and Cohan, A. (2020). Longformer: The Long-Document Transformer. arXiv.
73. Khandelwal, U., Levy, O., Jurafsky, D., Zettlemoyer, L., and Lewis, M. (2020, January 26–30). Generalization through Memorization: Nearest Neighbor Language Models. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
74. Gao, L., Ma, X., Lin, J., and Callan, J. (2023, January 9–14). Precise Zero-Shot Dense Retrieval without Relevance Labels. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, ON, Canada.10.18653/v1/2023.acl-long.99 ↗
75. Khattab, O., and Zaharia, M. (2020, January 25–30). ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Xi’an, China.10.1145/3397271.3401075 ↗
76. Reimers, N., and Gurevych, I. (2019, January 3–7). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1410 ↗
77. Hoffmann, J., Borgeaud, S., Mensch, A., Buchatskaya, E., Cai, T., Rutherford, E., Casas, D.D., Hendricks, L.A., Welbl, J., and Clark, A. (December, January 28). Training Compute-Optimal Large Language Models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LN, USA.
78. Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., and Yih, W.t. (2020, January 16–20). Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Virtually.10.18653/v1/2020.emnlp-main.550 ↗
79. Izacard, G., and Grave, E. (2021, January 19–23). Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Online.10.18653/v1/2021.eacl-main.74 ↗
80. Wu, S., Irsoy, O., Lu, S., Dabravolski, V., Dredze, M., Gehrmann, S., Kambadur, P., Rosenberg, D., and Mann, G. (2023). BloombergGPT: A Large Language Model for Finance. arXiv.
81. Yang, H., Liu, X.Y., and Wang, C.D. (2023). FinGPT: Open-Source Financial Large Language Models. arXiv.10.2139/ssrn.4489826 ↗
82. Large Language Models Encode Clinical Knowledge10.1038/s41586-023-06291-2 ↗
83. Dhuliawala, S., Komeili, M., Xu, J., Raileanu, R., Li, X., Celikyilmaz, A., and Weston, J. (2024, January 11–16). Chain-of-Verification Reduces Hallucination in Large Language Models. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2024, Bangkok, Thailand.10.18653/v1/2024.findings-acl.212 ↗
84. Yan, S.Q., Gu, J.C., Zhu, Y., and Ling, Z.H. (2024). Corrective Retrieval Augmented Generation. arXiv.10.2139/ssrn.5267341 ↗
85. Kaddour, J., Harris, J., Mozes, M., Bradley, H., Raileanu, R., and McHardy, R. (2023). Challenges and Applications of Large Language Models. arXiv.
86. Liu, Y., Iter, D., Xu, Y., Wang, S., Xu, R., and Zhu, C. (2023, January 6–10). G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore.10.18653/v1/2023.emnlp-main.153 ↗
87. Patil, S.G., Zhang, T., Wang, X., and Gonzalez, J.E. (2023). Gorilla: Large Language Model Connected with Massive APIs. arXiv.
88. Dao, T., Fu, D.Y., Ermon, S., Rudra, A., and Ré, C. (December, January 28). FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LN, USA.
89. Atlas: Few-shot Learning with Retrieval Augmented Language Models
90. Yang, H., Zhang, M., Wei, D., and Guo, J. (2024, January 26–28). SRAG: Speech Retrieval Augmented Generation for Spoken Language Understanding. Proceedings of the 2024 IEEE 2nd International Conference on Control, Electronics and Computer Technology (ICCECT), Jilin, China.10.1109/ICCECT60629.2024.10546001 ↗
91. Wu, T., Luo, L., Li, Y.F., Pan, S., Vu, T.T., and Haffari, G. (2024). Continual Learning for Large Language Models: A Survey. arXiv.10.18653/v1/2025.emnlp-tutorials.7 ↗
92. Chen, W., He, H., Cheng, Y., Chang, M.W., Cohen, W.W., and Wang, W.Y. (2022, January 7–11). MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, United Arab Emirates.10.18653/v1/2022.emnlp-main.375 ↗
93. Guu, K., Lee, K., Tung, Z., Pasupat, P., and Chang, M.W. (2020, January 12–18). Retrieval-Augmented Language Model Pre-Training. Proceedings of the 37th International Conference on Machine Learning (ICML), Virtual Event.
94. Wang, L., Yang, N., and Wei, F. (2023, January 6–10). Query2doc: Query Expansion with Large Language Models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), Singapore.10.18653/v1/2023.emnlp-main.585 ↗
95. Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 6–12). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), Philadelphia, PA, USA.10.3115/1073083.1073135 ↗
96. Bajaj, P., Campos, D., Craswell, N., Deng, L., Gao, J., Liu, X., Majumder, R., McNamara, A., Mitra, B., and Nguyen, T. (2016). MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. arXiv.
97. Billion-scale Similarity Search with GPUs10.1109/TBDATA.2019.2921572 ↗
98. Lin, C.Y. (2004, January 25–26). ROUGE: A Package for Automatic Evaluation of Summaries. Proceedings of the Text Summarization Branches out, Barcelona, Spain.
99. Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2020, January 26–30). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
100. See, A., Liu, P.J., and Manning, C.D. (August, January 30). Get To The Point: Summarization with Pointer-Generator Networks. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL), Vancouver, BC, Canada.