Building and Validating a Coal Mine Safety Question-Answering System with a Large Language Model Through a Two-Stage Fine-Tuning Method

Artificial intelligence technology holds significant importance for building intelligent question-answering systems in the field of coal mine safety and enhancing safety management levels. Currently, there is a lack of specialized large language models and high-quality question-answering datasets in this field. To address this, this study proposes a two-stage fine-tuning method based on Low-Rank Adaptation (LoRA) and Group Sequence Policy Optimization (GSPO) for training a question-answering model tailored to the coal mine safety domain. The research begins by constructing a dedicated question-answering dataset based on domain-specific regulatory documents. Subsequently, using Qwen2.5-7B Instruct as the base model, the study fine-tunes the model through supervised learning with LoRA technology, followed by further optimization of the model’s performance using the GSPO reinforcement learning algorithm. Experiments show that the model trained with this method exhibits significant improvements in coal mine safety-related tasks, achieving superior results on multiple automated evaluation metrics compared to contrast models of similar scale. This study validates the effectiveness of the two-stage fine-tuning method in adapting large language models (LLMs) to specific domains, providing a new technical approach for the intelligentization of coal mine safety. It should be noted that due to the lack of external data, this study relies on a self-constructed dataset and has not yet undergone external independent validation, which constitutes the main limitation of the current work.