journal article·2025-11-29Open access

DAFT: Domain-Augmented Fine-Tuning for Large Language Models in Emotion Recognition of Health Misinformation

Youlin Zhao, Xingmi Zhu, Wanqing Tang, Linxing Zhou, Li Feng, Mingwei Tang

Applied Sciences· Volume 15· Issue 23

Abstract

This study proposes a domain-augmented fine-tuning strategy for improving emotion recognition in health misinformation using pre-trained large language models (LLMs). The proposed method aims to address key limitations of existing approaches, including insufficient precision, weak domain adaptability, and low recognition accuracy for complex emotional expressions in health-related misinformation. Specifically, the Domain-Augmented Fine-Tuning (DAFT) method extends a health emotion lexicon to annotate emotion-oriented corpora, designs task-specific prompt templates to enhance semantic understanding, and fine-tunes GPT-based LLMs through parameter-efficient prompt tuning. Empirical experiments conducted on a health misinformation dataset demonstrate that DAFT substantially improves model performance in terms of prediction error, emotional vector structural similarity, probability distribution consistency, and classification accuracy. The fine-tuned GPT-4o model achieves the best overall performance, attaining an emotion recognition accuracy of 84.77%, with its F1-score increasing by 20.78% relative to the baseline model. Nonetheless, the corpus constructed in this study is based on a six-dimensional emotion framework, which may not fully capture nuanced emotions in complex linguistic contexts. Moreover, the dataset is limited to textual information, and future research should incorporate multimodal data such as images and videos. Overall, the DAFT method effectively enhances the domain adaptability of LLMs and provides a lightweight yet efficient approach to emotion recognition in health misinformation scenarios.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Misinformation and Its Impacts · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Business School, Hohai University, Nanjing 211100, China

School of Cultural Heritage and Information Management, Shanghai University, Shanghai 200444, China

Hohai University Library, Nanjing 211100, China

School of Engineering Audit, Nanjing Audit University, Nanjing 211815, China

Funding

National Social Science Foundation General Project · The Fundamental Research Funds for the Central Universities

References (54)

Show source-provided references
1. Utilizing social media for public health advocacy and awareness in digital health communication10.61942/msj.v2i1.96 ↗
2. Misinformation sharing and social media fatigue during COVID-19: An affordance and cognitive load perspective10.1016/j.techfore.2020.120201 ↗
3. Zhou, X., Jain, A., Phoha, V.V., and Zafarani, R. (2019). Fake News Early Detection: An Interdisciplinary Study. arXiv.10.1145/3308560.3316476 ↗
4. Chen, C., Wang, H., Shapiro, M., Xiao, Y., Wang, F., and Shu, K. (2022). Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues. arXiv.
5. Predicting healthcare professionals’ intention to correct health misinformation on social media10.1016/j.tele.2022.101864 ↗
6. Emotion detection for misinformation: A review10.1016/j.inffus.2024.102300 ↗
7. Horner, C.G., Galletta, D., Crawford, J., and Shirsat, A. (2023). Emotions: The unexplored fuel of fake news on social media. Fake News on the Internet, Routledge.10.4324/9781003433934-7 ↗
8. A comprehensive survey on machine learning approaches for fake news detection
9. Combining Sentiment Lexicons and Content-Based Features for Depression Detection10.1109/MIS.2021.3093660 ↗
10. A Survey on Aspect-Based Sentiment Classification
11. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
12. Peng, C., Yang, X., Smith, K.E., Yu, Z., Chen, A., Bian, J., and Wu, Y. (2024). Model Tuning or Prompt Tuning a Study of Large Language Models for Clinical Concept and Relation Extraction. J. Biomed. Inform., 153.10.1016/j.jbi.2024.104630 ↗
13. Parthasarathy, V.B., Zafar, A., Khan, A., and Shahid, A. (2024). The ultimate guide to fine-tuning llms from basics to breakthroughs: An exhaustive review of technologies, research, best practices, applied research challenges and opportunities. arXiv.
14. White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., and Schmidt, D.C. (2023). A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT. arXiv.
15. Maharjan, J., Garikipati, A., Preet Singh, N., Cyrus, L., Sharma, M., Ciobanu, M., Barnes, G., Thapa, R., Mao, Q., and Das, R. (2024). OpenMedLM: Prompt engineering can out-perform fine-tuning in medical question-answering with open-source large language models. Sci. Rep., 1.10.1038/s41598-024-64827-6 ↗
16. Xu, H., Elbayad, M., Murray, K., Maillard, J., and Goswami, V. (2023). Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity. arXiv.10.18653/v1/2023.findings-emnlp.856 ↗
17. Fernandez, M., and Alani, H. (2018, January 23–27). Online misinformation: Challenges and future directions. Proceedings of the Companion of the Web Conference 2018, Lyon, France.10.1145/3184558.3188730 ↗
18. Disinformation and misinformation triangle: A conceptual model for “fake news” epidemic, causal factors and interventions
19. Karami, M., Nazer, T.H., and Liu, H. (September, January 30). Profiling Fake News Spreaders on Social Media through Psychological and Motivational Factors. Proceedings of the 32nd ACM Conference on Hypertext and Social Media, Online.
20. Rumor, Gossip and Urban Legends
21. Wang, B., Ma, J., Lin, H., Yang, Z., Yang, R., Tian, Y., and Chang, Y. (2024, January 13–17). Explainable fake news detection with large language model via defense among competing wisdom. Proceedings of the ACM Web Conference 2024, Association for Computing Machinery, Singapore.10.1145/3589334.3645471 ↗
22. Systematic Literature Review on the Spread of Health-related Misinformation on Social Media10.1016/j.socscimed.2019.112552 ↗
23. A comprehensive analysis of COVID-19 misinformation, public health impacts, and communication strategies: Scoping review10.2196/56931 ↗
24. Fake news detection in social media based on sentiment analysis using classifier techniques10.1007/s11042-023-14883-3 ↗
25. Multimodal Sentiment Analysis: A Survey and Comparison
26. Chen, H., Zheng, P., Wang, X., Hu, S., Zhu, B., Hu, J., Wu, X., and Lyu, S. (2023, January 1). Harnessing the Power of Text-image Contrastive Models for Automatic Detection of Online Misinformation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00099 ↗
27. Yousif, A., and Buckley, J. (2022). Impact of Sentiment Analysis in Fake Review Detection. arXiv.
28. Hamed, S.K., Ab Aziz, M.J., and Yaakub, M.R. (2023). Fake News Detection Model on Social Media by Leveraging Sentiment Analysis of News Content and Emotion Analysis of Users’ Comments. Sensors, 4.10.3390/s23041748 ↗
29. Xuewen, Z., Yaxiong, P., Xiao, G., and Gang, L. (2023, January 21). Sentiment analysis-based social network rumor detection model with bi-directional graph convolutional networks. Proceedings of the International Conference on Computer Application and Information Security, Online.
30. Shin, J., Tang, C., Mohati, T., Nayebi, M., Wang, S., and Hemmati, H. (2025, January 28–29). Prompt Engineering or Fine-Tuning: An Empirical Assessment of LLMs for Code. Proceedings of the 2025 IEEE/ACM 22nd International Conference on Mining Software Repositories (MSR), Ottawa, ON, Canada.10.1109/MSR66628.2025.00082 ↗
31. ChatGPT A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope10.1016/j.iotcps.2023.04.003 ↗
32. Wang, Y., Rao, S., Lee, J., Jobanputra, M., and Demberg, V. (2025). B-cos LM: Efficiently Transforming Pre-trained Language Models for Improved Explainability. arXiv.
33. A Brief Overview of ChatGPT:The History, Status Quo and Potential Future Development10.1109/JAS.2023.123618 ↗
34. A reliable knowledge processing framework for combustion science using foundation models10.1016/j.egyai.2024.100365 ↗
35. Public Health and Online Misinformation: Challenges and Recommendations10.1146/annurev-publhealth-040119-094127 ↗
36. Prevalence of Health Misinformation on Social Media: Systematic Review10.2196/17187 ↗
37. A novel approach to the creation of a labelling lexicon for improving emotion analysis in text10.1108/EL-04-2020-0110 ↗
38. WordNet: A Lexical Database for the English Language
39. Use of ‘Pharmaceutical services’ Medical Subject Headings (MeSH) in articles assessing pharmacists’ interventions
40. A survey of aspect-based sentiment analysis classification with a focus on graph neural network methods10.1007/s11042-023-17701-y ↗
41. A Review of The Handbook of Cognition and Emotion10.1080/00224545.2013.846109 ↗
42. A survey on sentiment analysis methods, applications, and challenges10.1007/s10462-022-10144-1 ↗
43. Intensional Learning to Efficiently Build up Automatically Annotated Emotion Corpora
44. Few-Shot Text Classification with an Efficient Prompt Tuning Method in Meta-Learning Framework10.1142/S0218001424510066 ↗
45. A survey on aspect base sentiment analysis methods and challenges10.1016/j.asoc.2024.112249 ↗
46. Vaccine misinformation on social media—Topic-based content and sentiment analysis of Polish vaccine-deniers’ comments on Facebook
47. A dataset for Sentiment analysis of Entities in News headlines (SEN)10.1016/j.procs.2021.09.136 ↗
48. A survey on classification techniques for opinion mining and sentiment analysis10.1007/s10462-017-9599-6 ↗
49. Root mean square error (RMSE) or mean absolute error (MAE)?—Arguments against avoiding RMSE in the literature10.5194/gmd-7-1247-2014 ↗
50. Identification of Suspect Using Transformer and Cosine Similarity Model for Forensic Voice Comparison10.1002/spy2.70038 ↗
51. Nielsen, F. (2019). On the Jensen–Shannon Symmetrization of Distances Relying on Abstract Means. Entropy, 21.10.3390/e21050485 ↗
52. Probabilistic interpretation of algebraic inequalities related to reliability and risk10.1002/qre.3345 ↗
53. An improved method to construct basic probability assignment based on the confusion matrix for classification problem10.1016/j.ins.2016.01.033 ↗
54. The Impact of Oversampling and Undersampling on Aspect-Based Sentiment Analysis of Indramayu Tourism Using Logistic Regression