Enhancing Plant Protection Knowledge with Large Language Models: A Fine-Tuned Question-Answering System Using LoRA
Source abstract
Abstract
To enhance the accessibility and accuracy of plant protection knowledge for agricultural practitioners, this study develops an intelligent question-answering (QA) system based on a large language model (LLM). A local knowledge base was constructed by vectorizing 7000 research papers and books in the field of plant protection, from which 568 representative papers were selected to generate QA data using an LLM. After data cleaning and filtering, a fine-tuning dataset comprising 9000 question–answer pairs was curated. To optimize the model’s performance, low-rank adaptation (LoRA) was applied to the InterLM-20B model, resulting in the InterLM-20B-LoRA, which was integrated with Langchain-ChatChat and the local knowledge base to develop the QA system. Additionally, retrieval-augmented generation (RAG) technology was implemented to enhance response accuracy by enabling the model to retrieve relevant field-specific knowledge before generating answers, effectively mitigating the risk of hallucinated information. The experimental results demonstrate that the proposed system achieves an answer accuracy of 97%, highlighting its potential as an advanced solution for intelligent agricultural QA services.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Dengue and Mosquito Control Research · Advanced Text Analysis Techniques · Species Distribution and Climate Change
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China
Funding
National Natural Science Foundation of China · Research Foundation of Education Bureau of Hunan Province, China · Research Foundation of Science and Technology Bureau of Hunan Province, China
References (44)
Show source-provided references
1. Agriculture in the Global Economy10.1257/jep.28.1.121 ↗
2. Advances in plant disease and pest management10.1017/S0021859610000997 ↗
3. Challenges in monitoring and managing plant diseases in developing countries10.1007/s41348-018-0145-9 ↗
4. Climate change, plant diseases and food security: An overview10.1111/j.1365-3059.2010.02411.x ↗
5. A survey on large language models: Applications, challenges, limitations, and practical usage
6. Patil, R., and Gudivada, V. (2024). A review of current trends, techniques, and challenges in large language models (llms). Appl. Sci., 14.10.20944/preprints202402.0357.v1 ↗
7. Bender, E.M., Gebru, T., McMillan-Major, A., and Shmitchell, S. (2021, January 3–10). On the dangers of stochastic parrots: Can language models be too big?. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, Virtual Event, Canada.10.1145/3442188.3445922 ↗
8. Language models are few-shot learners
9. Wortsman, M., Ilharco, G., Kim, J.W., Li, M., Kornblith, S., Roelofs, R., Lopes, R.G., Hajishirzi, H., Farhadi, A., and Namkoong, H. (2022, January 18–24). Robust fine-tuning of zero-shot models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00780 ↗
10. Kumar, A., Raghunathan, A., Jones, R., Ma, T., and Liang, P. (2022, January 25–29). Fine-Tuning Can Distort Pretrained Features and Underperform Out-of-Distribution. Proceedings of the 10th International Conference on Learning Representations, Virtual Event.
11. dos Santos Junior, J.C., Hu, R., Song, R., and Bai, Y. (2024, January 25–29). Domain-Driven LLM Development: Insights into RAG and Fine-Tuning Practices. Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Barcelona, Spain.10.1145/3637528.3671445 ↗
12. A survey on question answering systems with classification10.1016/j.jksuci.2014.10.007 ↗
13. Green, B.F., Wolf, A.K., Chomsky, C., and Laughery, K. (1961, January 9–11). Baseball: An automatic question-answerer. Proceedings of the Western Joint IRE-AIEE-ACM Computer Conference, Los Angeles, CA, USA.10.1145/1460690.1460714 ↗
14. Zampolli, A. (1977). Lunar Rocks in Natural English: Explorations in Natural Language Question Answering. Linguistic Structures Processing, Linguistic Structures Processing.
15. Wilensky, R. (1987). The Berkeley UNIX consultant project. Wissensbasierte Systeme: 2. Internationaler GI-Kongreß München, Springer.10.21236/ADA197291 ↗
16. Building Watson: An overview of the DeepQA project
17. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
18. GPT-3: Its nature, scope, limits, and consequences10.1007/s11023-020-09548-1 ↗
19. FarmChat: A conversational agent to answer farmer queries10.1145/3287048 ↗
20. Tende, I.G., Aburada, K., Yamaba, H., Katayama, T., and Okazaki, N. (2021). Proposal for a crop protection information system for rural farmers in tanzania. Agronomy, 11.10.3390/agronomy11122411 ↗
21. AgAsk: An agent to help answer farmer’s questions from scientific documents10.1007/s00799-023-00369-y ↗
22. Zhang, D., Chen, X., Zhang, Y., and Qin, S. (2021). Template-based Chatbot for agriculture related FAQs. arXiv.
23. Dhavale, C., Pawar, T., Singh, A., Pole, S., and Sabat, K. (2024, January 8–10). Revolutionizing farming: Gan-enhanced imaging, cnn disease detection, and llm farmer assistant. Proceedings of the 2024 2nd International Conference on Computer, Communication and Control (IC4), Indore, India.10.1109/IC457434.2024.10486501 ↗
24. Klair, Y.S., Agrawal, K., and Kumar, A. (2024, January 5–16). Impact of generative ai in diagnosing diseases in agriculture. Proceedings of the 2024 2nd International Conference on Disruptive Technologies (ICDT), Greater Noida, India.10.1109/ICDT61202.2024.10489759 ↗
25. Madaan, V., Bindal, G., Singh, S., Yadav, S.K., Singh, A., Sinha, P., and Nagpal, D. (2023, January 29–30). Integrating language models and machine learning for crop disease detection for farmer guidance. Proceedings of the Workshop on Advances in Computational Intelligence (ACI-2023) Co-Located with the 2nd International Conference on Artificial Intelligence and Data Science (ICAIDS-2023), Hyderabad, Telangana, India.
26. Majumder, S., and Khandelwal, Y. (2024, January 2–4). Computer vision and Generative AI for yield prediction in Digital Agriculture. Proceedings of the 2024 2nd International Conference on Networking and Communications (ICNWC), Chennai, India.10.1109/ICNWC60771.2024.10537337 ↗
27. A Comprehensive Approach Towards Wheat Leaf Disease Identification Leveraging Transformer Models and Federated Learning10.1109/ACCESS.2024.3438544 ↗
28. Li, W., Yu, L., Wu, M., Liu, J., Hao, M., and Li, Y. (2023, January 6–8). DoctorGPT: A Large Language Model with Chinese Medical Question-Answering Capabilities. Proceedings of the 2023 International Conference on High Performance Big Data and Intelligent Systems (HDIS), Macau, China.10.1109/HDIS60872.2023.10499472 ↗
29. Honglin, X., Sheng, W., Yitao, Z., Zhao, Z., Liu, Y., Huang, L., Wang, Q., and Shen, D. (2023). Doctorglm: Fine-tuning your chinese doctor is not a herculean task. arXiv.
30. Wenzek, G., Lachaux, M.-A., Conneau, A., Chaudhary, V., Guzmán, F., Joulin, A., and Grave, E. (2020, January 13–15). CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data. Proceedings of the Twelfth Language Resources and Evaluation Conference, Marseille, France.
31. Lee, K., Ippolito, D., Nystrom, A., Zhang, C., Eck, D., Callison-Burch, C., and Carlini, N. (2022, January 22–27). Deduplicating Training Data Makes Language Models Better. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Dublin, Ireland.10.18653/v1/2022.acl-long.577 ↗
32. Alberti, C., Andor, D., Pitler, E., Devlin, J., and Collins, M. (August, January 28). Synthetic QA Corpora Generation with Roundtrip Consistency. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
33. LIQUID: A framework for list question answering dataset generation
34. (2023). InternLM Team. Internlm: A Multilingual Language Model with Progressively Enhanced Capabilities [EB/OL].
35. Lora: Low-rank adaptation of large language models
36. Retrieval-augmented generation for knowledge-intensive nlp tasks
37. Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., and Cui, B. (2024). Retrieval-augmented generation for ai-generated content: A survey. arXiv.
38. A survey on evaluation of large language models10.1145/3641289 ↗
39. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002, January 7–12). BLEU: A method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, PA, USA.10.3115/1073083.1073135 ↗
40. Lin, C.Y. (2004). Rouge: A package for automatic evaluation of summaries. Text Summarization Branches Out, Association for Computational Linguistics.
41. Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2020, January 26–30). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
42. Wang, A., Cho, K., and Lewis, M. (2020, January 5–10). Asking and answering questions to evaluate the factual consistency of summaries. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.450 ↗
43. Kryściński, W., McCann, B., Xiong, C., and Socher, R. (2020, January 16–20). Evaluating the factual consistency of abstractive text summarization. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.750 ↗
44. Durmus, E., He, H., and Diab, M. (2020, January 5–10). FEQA: A question answering evaluation framework for faithfulness assessment in abstractive summarization. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.454 ↗