journal article·2025Open access

An Analytical Review of Large Language Models Leveraging KDGI Fine-Tuning, Quantum Embedding’s, and Multimodal Architectures

Uddagiri Sirisha, Chanumolu Kiran Kumar, Revathi Durgam, Poluru Eswaraiah, G Muni Nagamani

Computers, Materials & Continua· Volume 83· Issue 3

Abstract

A complete examination of Large Language Models’ strengths, problems, and applications is needed due to their rising use across disciplines. Current studies frequently focus on single-use situations and lack a comprehensive understanding of LLM architectural performance, strengths, and weaknesses. This gap precludes finding the appropriate models for task-specific applications and limits awareness of emerging LLM optimization and deployment strategies. In this research, 50 studies on 25+ LLMs, including GPT-3, GPT-4, Claude 3.5, DeepKet, and hybrid multimodal frameworks like ContextDET and GeoRSCLIP, are thoroughly reviewed. We propose LLM application taxonomy by grouping techniques by task focus—healthcare, chemistry, sentiment analysis, agent-based simulations, and multimodal integration. Advanced methods like parameter-efficient tuning (LoRA), quantum-enhanced embeddings (DeepKet), retrieval-augmented generation (RAG), and safety-focused models (GalaxyGPT) are evaluated for dataset requirements, computational efficiency, and performance measures. Frameworks for ethical issues, data limited hallucinations, and KDGI-enhanced fine-tuning like Woodpecker’s post-remedy corrections are highlighted. The investigation’s scope, mad, and methods are described, but the primary results are not. The work reveals that domain-specialized fine-tuned LLMs employing RAG and quantum-enhanced embeddings perform better for context-heavy applications. In medical text normalization, ChatGPT-4 outperforms previous models, while two multimodal frameworks, GeoRSCLIP, increase remote sensing. Parameter-efficient tuning technologies like LoRA have minimal computing cost and similar performance, demonstrating the necessity for adaptive models in multiple domains. To discover the optimum domain-specific models, explain domain-specific fine-tuning, and present quantum and multimodal LLMs to address scalability and cross-domain issues. The framework helps academics and practitioners identify, adapt, and innovate LLMs for different purposes. This work advances the field of efficient, interpretable, and ethical LLM application research.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (75)

Show source-provided references
1. Exploring the answering capability of large language models in addressing complex knowledge in entrepreneurship education10.1109/TLT.2024.3456128 ↗
2. Large language models and rule-based approaches in domain-specific communication10.1109/ACCESS.2024.3436902 ↗
3. Chat2VIS: generating data visualizations via natural language using ChatGPT, codex and GPT-3 large language models10.1109/ACCESS.2023.3274199 ↗
4. Exploiting intel advanced matrix extensions (AMX) for large language model inference10.1109/LCA.2024.3397747 ↗
5. Large language models are not models of natural language: they are corpus models10.1109/ACCESS.2022.3182505 ↗
6. Strobelt · IEEE Trans Vis Comput Graph · 2023 · 29 · 1146
7. Derivative-free optimization for low-rank adaptation in large language models10.1109/TASLP.2024.3477330 ↗
8. Sample trajectory selection method based on large language model in reinforcement learning10.1109/ACCESS.2024.3395457 ↗
9. A transformer-BERT integrated model-based automatic conversation method under English context10.1109/ACCESS.2024.3388100 ↗
10. Language models for hierarchical classification of radiology reports with attention mechanisms, BERT, and GPT-410.1109/ACCESS.2024.3402066 ↗
11. Live streaming speech recognition using deep bidirectional LSTM acoustic models and interpolated language models10.1109/TASLP.2021.3133216 ↗
12. Wang · IEEE/ACM Trans Audio Speech Lang Process · 2024 · 32 · 475510.1109/TASLP.2024.3487419 ↗
13. Large language model for smart inverter cyber-attack detection via textual analysis of volt/VAR commands10.1109/TSG.2024.3453648 ↗
14. Embodied intelligence in mining: leveraging multi-modal large language models for autonomous driving in mines10.1109/TIV.2024.3417938 ↗
15. Large language models make sample-efficient recommender systems10.1007/s11704-024-40039-z ↗
16. Applications of large language models in oncology
17. Meaning and understanding in large language models10.1007/s11229-024-04878-4 ↗
18. Requirement-service mapping technology in the industrial application field based on large language models
19. Large language models predict human sensory judgments across six modalities10.1038/s41598-024-72071-1 ↗
20. Large language models for oncological applications10.1007/s00432-023-04824-w ↗
21. Give us the facts: enhancing large language models with knowledge graphs for fact-aware language modeling10.1109/TKDE.2024.3360454 ↗
22. Toward robust evaluation: a comprehensive taxonomy of datasets and metrics for open domain question answering in the era of large language models10.1109/ACCESS.2024.3446854 ↗
23. Intelligent practices of large language models in digital government services10.1109/ACCESS.2024.3349969 ↗
24. Generation of asset administration shell with large language model agents: toward semantic interoperability in digital twins in the context of Industry 4.010.1109/ACCESS.2024.3415470 ↗
25. Comparative analysis of deep natural networks and large language models for aspect-based sentiment analysis10.1109/ACCESS.2024.3386969 ↗
26. Leveraging the OPT large language model for sentiment analysis of game reviews10.1109/TG.2023.3313121 ↗
27. Auffusion: leveraging the power of diffusion and large language models for text-to-audio generation10.1109/TASLP.2024.3485485 ↗
28. Refashioning emotion recognition modeling: the advent of generalized large models10.1109/TCSS.2024.3396345 ↗
29. Evaluation and analysis of large language models for clinical text augmentation and generation
30. Text-inductive graphone-based language adaptation for low-resource speech synthesis10.1109/TASLP.2024.3369537 ↗
31. GalaxyGPT: a hybrid framework for large language model safety10.1109/ACCESS.2024.3425662 ↗
32. A security risk taxonomy for prompt-based interaction with large language models10.1109/ACCESS.2024.3450388 ↗
33. LUNA: a model-based universal analysis framework for large language models10.1109/TSE.2024.3411928 ↗
34. RS5M and GeoRSCLIP: a large-scale vision-language dataset and a large vision-language model for remote sensing
35. OCRBench: on the hidden mystery of OCR in large multimodal models10.1007/s11432-024-4235-6 ↗
36. BELT: bootstrapped EEG-to-language training by natural language supervision10.1109/TNSRE.2024.3450795 ↗
37. Large language models for clinical text cleansing enhance medical concept normalization10.1109/ACCESS.2024.3472500 ↗
38. Large language models and multimodal foundation models for precision oncology10.1038/s41698-024-00573-2 ↗
39. Large language models propagate race-based medicine10.1038/s41746-023-00939-z ↗
40. Visistant: a conversational chatbot for natural language to visualizations with gemini large language models10.1109/ACCESS.2024.3465541 ↗
41. Beyond binary classification: a fine-grained safety dataset for large language models10.1109/ACCESS.2024.3393245 ↗
42. Music curriculum research using a large language model, cloud computing and data mining technologies10.13052/jwe1540-9589.2323 ↗
43. Comparing the dental knowledge of large language models10.1038/s41415-024-8015-2 ↗
44. When large language models meet personalization: perspectives of challenges and opportunities10.1007/s11280-024-01276-1 ↗
45. KPLLM-STE: knowledge-enhanced and prompt-aware large language models for short-text expansion10.1007/s11280-024-01322-y ↗
46. An intelligent industrial visual monitoring and maintenance framework empowered by large-scale visual and language models10.1109/TICPS.2024.3414292 ↗
47. Discrimination bias detection through categorical association in pre-trained language models10.1109/ACCESS.2024.3482010 ↗
48. Augmenting interpretable models with large language models during training10.1038/s41467-023-43713-1 ↗
49. Transforming dental diagnostics with artificial intelligence: advanced integration of ChatGPT and large language models for patient care10.3389/fdmed.2024.1456208 ↗
50. Generalization potential of large language models10.1007/s00521-024-10827-6 ↗
51. Neural data augmentation for legal overruling task: small deep learning models vs. large language models10.1007/s11063-024-11574-4 ↗
52. Quantum space-efficient large language models for Prolog query translation10.1007/s11128-024-04559-8 ↗
53. Contextual object detection with multimodal large language models10.1007/s11263-024-02214-4 ↗
54. Large language models for generative information extraction: a survey10.1007/s11704-024-40555-y ↗
55. Interactive computer-aided diagnosis on medical image using large language models10.1038/s44172-024-00271-8 ↗
56. Matching patients to clinical trials with large language models10.1038/s41467-024-53081-z ↗
57. Clinical decision support for bipolar depression using large language models10.1038/s41386-024-01841-2 ↗
58. Clinical efficacy of pre-trained large language models through the lens of aphasia10.1038/s41598-024-66576-y ↗
59. Data extraction from polymer literature using large language models10.1038/s43246-024-00708-9 ↗
60. Autonomous chemical research with large language models10.1038/s41586-023-06792-0 ↗
61. Exploring the representation of Chinese cultural symbols dissemination in the era of large language models10.1007/s40636-024-00293-z ↗
62. A survey on large language models for recommendation10.1007/s11280-024-01291-2 ↗
63. Large language models empowered agent-based modeling and simulation: a survey and perspectives10.1057/s41599-024-03611-3 ↗
64. Woodpecker: hallucination correction for multimodal large language models10.1007/s11432-024-4251-x ↗
65. How secure is AI-generated code: a large-scale comparison of large language models10.1007/s10664-024-10590-1 ↗
66. A few-shot learning method based on knowledge graph in large language models
67. Probabilistic medical predictions of large language models10.1038/s41746-024-01366-4 ↗
68. Zero and few short learning using large language models for de-identification of medical records10.1109/ACCESS.2024.3439680 ↗
69. Accessible Russian large language models: open-source models and instructive datasets for commercial applications10.1134/S1064562423701168 ↗
70. Large language models design sequence-defined macromolecules via evolutionary optimization10.1038/s41524-024-01449-6 ↗
71. Large language models for chemistry robotics10.1007/s10514-023-10136-2 ↗
72. Leveraging large language models for predictive chemistry10.1038/s42256-023-00788-1 ↗
73. An analysis of large language models: their impact and potential applications10.1007/s10115-024-02120-8 ↗
74. Chinese fine-grained financial sentiment analysis with large language models
75. Multi-modal large language models in radiology: principles, applications, and potential