journal article·2023-03-26Open access

Multiplicative Vector Fusion Model for Detecting Deepfake News in Social Media

Yalamanchili Salini, Jonnadula Harikiran

Applied Sciences· Volume 13· Issue 7

Abstract

In the digital age, social media platforms are becoming vital tools for generating and detecting deepfake news due to the rapid dissemination of information. Unfortunately, today, fake news is being developed at an accelerating rate that can cause substantial problems, such as early detection of fake news, a lack of labelled data available for training, and identifying fake news instances that still need to be discovered. Identifying false news requires an in-depth understanding of authors, entities, and the connections between words in a long text. Unfortunately, many deep learning (DL) techniques have proven ineffective with lengthy texts to address these issues. This paper proposes a TL-MVF model based on transfer learning for detecting and generating deepfake news in social media. To generate the sentences, the T5, or Text-to-Text Transfer Transformer model, was employed for data cleaning and feature extraction. In the next step, we designed an optimal hyperparameter RoBERTa model for effectively detecting fake and real news. Finally, we propose a multiplicative vector fusion model for classifying fake news from real news efficiently. A real-time and benchmarked dataset was used to test and validate the proposed TL-MVF model. For the TL-MVF model, F-score, accuracy, precision, recall, and AUC were performance evaluation measures. As a result, the proposed TL-MVF performed better than existing benchmarks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Misinformation and Its Impacts · Spam and Phishing Detection · Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Engineering, VIT-AP University, Amaravati 522237, India

References (43)

Show source-provided references
1. Analysing machine learning enabled fake news detection techniques for diversified datasets
2. Fake news detection based on news content and social contexts: A transformer-based approach10.1007/s41060-021-00302-z ↗
3. Lai, C.-M., Chen, M.-H., Kristiani, E., Verma, V.K., and Yang, C.-T. (2022). Fake News Classification Based on Content Level Features. Appl. Sci., 12.10.3390/app12031116 ↗
4. Truică, C.O., Apostol, E.S., and Paschke, A. (2022, January 5–8). Awakened at CheckThat! 2022: Fake news detection using Bi-LSTM and sentence transformer. Proceedings of the CLEF 2022: Conference and Labs of the Evaluation Forum, Bologna, Italy.
5. Alonso, M.A., Vilares, D., Gómez-Rodríguez, C., and Vilares, J. (2021). Sentiment analysis for fake news detection. Electronics, 10.10.3390/electronics10111348 ↗
6. Liu, W., Zhou, P., Zhao, Z., Wang, Z., Ju, Q., Deng, H., and Wang, P. (2019). K-BERT: Enabling Language Representation with Knowledge Graph. arXiv.10.1609/aaai.v34i03.5681 ↗
7. Spradling, M., Straub, J., and Strong, J. (2021). Protection from ‘fake news’: The need for descriptive factual labeling for online content. Future Internet, 13.10.3390/fi13060142 ↗
8. He, P., Liu, X., Gao, J., and Chen, W. (2020). DeBERTa: Decoding-enhanced BERT with Disentangled Attention. arXiv.
9. Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q.V., and Salakhutdinov, R. (August, January 28). Transformer-XL: Attentive language models beyond a fixed-length context. Proceedings of the ACL 2019—57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.10.18653/v1/P19-1285 ↗
10. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of deep bidirectional transformers for language un-derstanding. Proceedings of the NAACL HLT 2019—2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
11. Al-Ahmad, B., Al-Zoubi, A., Abu Khurma, R., and Aljarah, I. (2021). An Evolutionary Fake News Detection Method for COVID-19 Pandemic Information. Symmetry, 13.10.3390/sym13061091 ↗
12. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018). Lecture Notes in Computer Science, Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece, 4–7 October 2018, Elsevier. Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics.
13. Abonizio, H.Q., De Morais, J.I., Tavares, G.M., and Junior, S.B. (2020). Language-Independent Fake News Detection: English, Portuguese, and Spanish Mutual Features. Futur. Internet, 12.10.3390/fi12050087 ↗
14. Zhu, Y., Sheng, Q., Cao, J., Nan, Q., Shu, K., Wu, M., Wang, J., and Zhuang, F. (2022). Memory-Guided Multi-View Multi-Domain Fake News Detection. IEEE Trans. Knowl. Data Eng., 1–14.10.1109/TKDE.2022.3185151 ↗
15. Mouratidis, D., Nikiforos, M., and Kermanidis, K. (2021). Deep Learning for Fake News Detection in a Pairwise Textual Input Schema. Computation, 9.10.3390/computation9020020 ↗
16. Segura-Bedmar, I., and Alonso-Bartolome, S. (2022). Multimodal Fake News Detection. Information, 13.10.3390/info13060284 ↗
17. social media and Fake News in the 2016 Election10.1257/jep.31.2.211 ↗
18. Fake News Detection on social media10.1145/3137597.3137600 ↗
19. Wang, W.Y. (August, January 30). “Liar, liar pants on fire”: A new benchmark dataset for fake news detection. Proceedings of the ACL 2017—55th Annual Meeting of the Association for Computational Linguistics, Vancuver, BC, Canada.10.18653/v1/P17-2067 ↗
20. Riedel, B., Augenstein, I., Spithourakis, G.P., and Riedel, S. (2017). A simple but tough-to-beat baseline for the Fake News Challenge stance detection task. arXiv.
21. Ghanem, B., Rosso, P., and Rangel, F. (, January November). Stance Detection in Fake News a Combined Feature Representation. Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), Brussels, Belgium.
22. A review on fake news detection 3T’s: Typology, time of detection, taxonomies10.1007/s10207-022-00625-3 ↗
23. Jwa, H., Oh, D., Park, K., Kang, J.M., and Lim, H. (2019). exBAKE: Automatic fake news detection model based on Bidirectional En-coder Representations from Transformers (BERT). Appl. Sci., 9.10.3390/app9194062 ↗
24. (2020, December 23). Fake News. Available online: https://www.kaggle.com/c/fake-news.
25. New explainability method for BERT-based model in fake news detection10.1038/s41598-021-03100-6 ↗
26. Dhiman, P., Kaur, A., Iwendi, C., and Mohan, S.K. (2023). A Scientometric Analysis of Deep Learning Approaches for Detecting Fake News. Electronics, 12.10.3390/electronics12040948 ↗
27. Fake News Detection Using Machine Learning Ensemble Methods10.1155/2020/8885861 ↗
28. Tida, V.S., and Hsu, S. (2022). Universal spam detection using transfer learning of BERT model. arXiv.10.24251/HICSS.2022.921 ↗
29. Exploring the limits of transfer learning with a unified text-to-text transformer
30. Pavlov, T., and Mirceva, G. (2022, January 23–27). COVID-19 Fake News Detection by Using BERT and RoBERTa models. Proceedings of the 2022 45th Jubilee International Convention on Information, Communication and Electronic Technology (MIPRO), Opatija, Croatia.10.23919/MIPRO55190.2022.9803414 ↗
31. (2020, December 23). Available online: https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset.
32. POLITICO (2020, December 23). World Net Daily. Available online: https://www.politico.com/news/world-net-daily.
33. (2020, December 23). Politifact. Available online: https://www.Politifact.com.
34. Singhania, S., Fernandez, N., and Rao, S. (2017). Neural Information Processing, Proceedings of the 24th International Conference, ICONIP 2017, Guangzhou, China, 14–18 November 2017, Springer.
35. Okano, E.Y., Liu, Z., Ji, D., and Ruiz, E.E.S. (2020). Computational, Proceedings of the Portuguese Language 14th International Conference, PROPOR 2020, Evora, Portugal, 2–4 March 2020, Springer.
36. Salini, Y., and HariKiran, J. (2022). Deepfakes on Retinal Images using GAN. Int. J. Adv. Comput. Sci. Appl., 13.10.14569/IJACSA.2022.0130880 ↗
37. Fake News Stance Detection Using Deep Learning Architecture (CNN-LSTM)10.1109/ACCESS.2020.3019735 ↗
38. Yang, K., Niven, T., and Kao, H. (2019). Fake news detection as natural language inference. arXiv.
39. FakeBERT: Fake news detection in social media with a BERT-based deep learning approach10.1007/s11042-020-10183-2 ↗
40. Ni, J., Abrego, G.H., Constant, N., Ma, J., Hall, K., Cer, D., and Yang, Y. (2021). Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models. arXiv.10.18653/v1/2022.findings-acl.146 ↗
41. Kumar, A., Trueman, T.E., and Cambria, E. (2021, January 26–27). Fake news detection using XLNet fine-tuning model. Proceedings of the 2021 International Conference on Computational Intelligence and Computing Applications (ICCICA), Nagpur, India.10.1109/ICCICA52458.2021.9697269 ↗
42. Gundapu, S., and Mamidi, R. (2021). Transformer based automatic COVID-19 fake news detection system. arXiv.
43. Amer, E., Kwak, K.-S., and El-Sappagh, S. (2022). Context-Based Fake News Detection Model Relying on Deep Learning Models. Electronics, 11.10.3390/electronics11081255 ↗