Large Language Model in Healthcare for the Prediction of Genetic Variants from Unstructured Text Medicine Data Using Natural Language Processing
Source abstract
Abstract
Large language models (LLMs) and natural language processing (NLP) have significant promise to improve efficiency and refine healthcare decision-making and clinical results. Numerous domains, including healthcare, are rapidly adopting LLMs for the classification of biomedical textual data in medical research. The LLM can derive insights from intricate, extensive, unstructured training data. Variants need to be accurately identified and classified to advance genetic research, provide individualized treatment, and assist physicians in making better choices. However, the sophisticated and perplexing language of medical reports is often beyond the capabilities of the devices we now utilize. Such an approach may result in incorrect diagnoses, which could affect a patient’s prognosis and course of therapy. This study evaluated the efficacy of the proposed model by looking at publicly accessible textual clinical data. We have cleaned the clinical textual data using various text preprocessing methods, including stemming, tokenization, and stop word removal. The important features are extracted using Bag of Words (BoW) and Term Frequency-Inverse Document Frequency (TFIDF) feature engineering methods. The important motive of this study is to predict the genetic variants based on the clinical evidence using a novel method with minimal error. According to the experimental results, the random forest model achieved 61% accuracy with 67% precision for class 9 using TFIDF features and 63% accuracy and a 73% F1 score for class 9 using Bag of Words features. The accuracy of the proposed BERT (Bidirectional Encoder Representations from Transformers) model was 70% with 5-fold cross-validation and 71% with 10-fold cross-validation. The research results provide a comprehensive overview of current LLM methods in healthcare, benefiting academics as well as professionals in the discipline.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Genetics, Bioinformatics, and Biomedical Research · Biomedical Text Mining and Ontologies · Artificial Intelligence in Healthcare
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (34)
Show source-provided references
1. Tnt-llm: text mining at scale with large language models
2. Recent advances in interactive machine translation with large language models10.1109/ACCESS.2024.3487352 ↗
3. Rothman · Transformers for natural language processing: build innovative deep neural network architectures for NLP with Python, PyTorch, TensorFlow, BERT, RoBERTa, and more · 2021
4. Predictive analytics in mental health leveraging LLM embeddings and machine learning models for social media analysis10.4018/IJWSR.338222 ↗
5. Enhancing extractive text summarization using natural language processing with an optimal deep learning model10.3934/math.2024616 ↗
6. AI-Driven learning management systems: modern developments, challenges and future trends during the age of ChatGPT
7. Evaluating the progression of artificial intelligence and large language models in medicine through comparative analysis of ChatGPT-3.5 and ChatGPT-4 in generating vascular surgery recommendations10.1016/j.jvsvi.2023.100049 ↗
8. Medigpt: exploring potentials of conventional and large language models on medical data10.1109/ACCESS.2024.3428918 ↗
9. Outcome prediction using multi-modal information: integrating large language model-extracted clinical information and image analysis10.3390/cancers16132402 ↗
10. A future role for health applications of large language models depends on regulators enforcing safety standards10.1016/S2589-7500(24)00124-9 ↗
11. Large language model prompting techniques for advancement in clinical medicine10.3390/jcm13175101 ↗
12. An entity extraction pipeline for medical text records using large language models: analytical study10.2196/54580 ↗
13. Large language models in healthcare and medical domain: a review10.3390/informatics11030057 ↗
14. A review on large language models: architectures, applications, taxonomies, open issues and challenges10.1109/ACCESS.2024.3365742 ↗
15. Evaluation and analysis of large language models for clinical text augmentation and generation
16. Zero and few short learning using large language models for de-identification of medical records10.1109/ACCESS.2024.3439680 ↗
17. Llms accelerate annotation for medical information extraction
18. Large language models in health care: development, applications, and challenges10.1002/hcs2.61 ↗
19. A study of generative large language model for medical research and healthcare10.1038/s41746-023-00958-w ↗
20. Annotated dataset creation through large language models for non-english medical NLP10.1016/j.jbi.2023.104478 ↗
21. A large language model for electronic health records10.1038/s41746-022-00742-2 ↗
22. Large language models in medicine10.1038/s41591-023-02448-8 ↗
23. Classifying unstructured text in electronic health records for mental health prediction models: large language model evaluation study10.2196/65454 ↗
24. The foundational capabilities of large language models in predicting postoperative risks using clinical notes10.1038/s41746-025-01489-2 ↗
25. Advancing EHR analysis: predictive medication modeling using LLMs10.1016/j.is.2025.102528 ↗
26. Scalable information extraction from free text electronic health records using large language models10.1186/s12874-025-02470-z ↗
27. BioBERT based named entity recognition in electronic medical record
28. Med-BERT: a pretraining framework for medical records named entity recognition10.1109/TII.2021.3131180 ↗
29. Utilizing ChatGPT-4 for providing medical information on blepharoplasties to patients10.1093/asj/sjad096 ↗
30. CVDLLM: automated cardiovascular disease diagnosis with large-language-model-assisted graph attentive feature interaction10.1109/TAI.2025.3527401 ↗
31. Preprocessing techniques for text mining-an overview
32. Ovalle A, Mehrabi N, Goyal P, Dhamala J, Chang KW, Zemel R, et al. Tokenization mWatters: navigating data-scarce tokenization for gender inclusive language technologies. arXiv:2312.11779. 2023. doi:10.48550/arXiv.2312.11779.10.18653/v1/2024.findings-naacl.113 ↗
33. Evaluating the ChatGPT family of models for biomedical reasoning and classification10.1093/jamia/ocad256 ↗
34. El-Gayar O, Al-Ramahi M, Wahbeh A, Nasralah T, Elnoshokaty A. A comparative analysis of the interpretability of LDA and LLM for topic modeling: the case of healthcare apps [Internet]. 2024 [cited 2025 Apr 29]. Available from: https://scholar.dsu.edu/bispapers/423.