journal article·2023-03-06Open access

Does Context Matter? Effective Deep Learning Approaches to Curb Fake News Dissemination on Social Media

Jawaher Alghamdi, Yuqing Lin, Suhuai Luo

Applied Sciences· Volume 13· Issue 5

Abstract

The prevalence of fake news on social media has led to major sociopolitical issues. Thus, the need for automated fake news detection is more important than ever. In this work, we investigated the interplay between news content and users’ posting behavior clues in detecting fake news by using state-of-the-art deep learning approaches, such as the convolutional neural network (CNN), which involves a series of filters of different sizes and shapes (combining the original sentence matrix to create further low-dimensional matrices), and the bidirectional gated recurrent unit (BiGRU), which is a type of bidirectional recurrent neural network with only the input and forget gates, coupled with a self-attention mechanism. The proposed architectures introduced a novel approach to learning rich, semantical, and contextual representations of a given news text using natural language understanding of transfer learning coupled with context-based features. Experiments were conducted on the FakeNewsNet dataset. The experimental results show that incorporating information about users’ posting behaviors (when available) improves the performance compared to models that rely solely on textual news data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Misinformation and Its Impacts · Spam and Phishing Detection · Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Physical Sciences, College of Engineering Science and Environment, The University of Newcastle, Callaghan, Newcastle, NSW 2308, Australia

Department of Computer Science, King Khalid University, Abha 62521, Saudi Arabia

References (39)

Show source-provided references
1. Kwak, H., Lee, C., Park, H., and Moon, S. (2010, January 26–30). What is Twitter, a Social Network or a News Media?. Proceedings of the 19th International Conference on World Wide Web, WWW’10, Raleigh, NC, USA.10.1145/1772690.1772751 ↗
2. Social media hoaxes, political ideology, and the role of issue confidence10.1016/j.tele.2018.11.001 ↗
3. Langin, K. (2018). Fake news spreads faster than true news on Twitter—Thanks to people, not bots. Sci. Mag.10.1126/science.aat5350 ↗
4. The spread of true and false news online10.1126/science.aap9559 ↗
5. Cure or Poison? Identity Verification and the Posting of Fake News on Social Media10.1080/07421222.2021.1990615 ↗
6. Automatic deception detection: Methods for finding fake news10.1002/pra2.2015.145052010082 ↗
7. Zhou, X., Jain, A., Phoha, V.V., and Zafarani, R. (2019). Fake News Early Detection: An Interdisciplinary Study. arXiv.10.1145/3308560.3316476 ↗
8. A survey of fake news: Fundamental theories, detection methods, and opportunities10.1145/3395046 ↗
9. Pérez-Rosas, V., Kleinberg, B., Lefevre, A., and Mihalcea, R. (2017). Automatic detection of fake news. arXiv.
10. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
11. Le, Q., and Mikolov, T. (2014, January 22–24). Distributed representations of sentences and documents. Proceedings of the International Conference on Machine Learning, PMLR, Beijing, China.
12. Wang, W.Y. (2017). “Liar, Liar Pants on Fire”: A New Benchmark Dataset for Fake News Detection. arXiv.10.18653/v1/P17-2067 ↗
13. An ensemble machine learning approach through effective feature extraction to classify fake news10.1016/j.future.2020.11.022 ↗
14. Behind the cues: A benchmarking study for fake news detection10.1016/j.eswa.2019.03.036 ↗
15. Clickbait detection on WeChat: A deep model integrating semantic and syntactic information10.1016/j.knosys.2022.108605 ↗
16. Blockchain-Enabled Deep Recurrent Neural Network Model for Clickbait Detection10.1109/ACCESS.2021.3137078 ↗
17. Razaque, A., Alotaibi, B., Alotaibi, M., Hussain, S., Alotaibi, A., and Jotsov, V. (2022). Clickbait Detection Using Deep Recurrent Neural Network. Appl. Sci., 12.10.3390/app12010504 ↗
18. Mouratidis, D., Nikiforos, M.N., and Kermanidis, K.L. (2021). Deep learning for fake news detection in a pairwise textual input schema. Computation, 9.10.3390/computation9020020 ↗
19. Shu, K., Mahudeswaran, D., Wang, S., Lee, D., and Liu, H. (2019). FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Media. arXiv.10.1089/big.2020.0062 ↗
20. Shu, K., Cui, L., Wang, S., Lee, D., and Liu, H. (2019, January 4–8). DEFEND: Explainable Fake News Detection. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD’19, Anchorage, AK, USA.10.1145/3292500.3330935 ↗
21. Ma, J., Gao, W., Wei, Z., Lu, Y., and Wong, K.F. (2015, January 19–23). Detect rumors using time series of social context information on microblogging websites. Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, Melbourne, Australia.10.1145/2806416.2806607 ↗
22. Castillo, C., Mendoza, M., and Poblete, B. (April, January 28). Information credibility on twitter. Proceedings of the 20th International Conference on World Wide Web, Hyderabad, India.
23. Shu, K., Zhou, X., Wang, S., Zafarani, R., and Liu, H. (2019, January 27–30). The role of user profiles for fake news detection. Proceedings of the 2019 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, Vancouver, BC, Canada.10.1145/3341161.3342927 ↗
24. Long, Y., Lu, Q., Xiang, R., Li, M., and Huang, C.R. (December, January 27). Fake News Detection Through Multi-Perspective Speaker Profiles. Proceedings of the Eighth International Joint Conference on Natural Language Processing, Taipei, Taiwan.
25. FakeBERT: Fake news detection in social media with a BERT-based deep learning approach10.1007/s11042-020-10183-2 ↗
26. Alghamdi, J., Lin, Y., and Luo, S. (2022, January 2–4). Modeling Fake News Detection Using BERT-CNN-BiLSTM Architecture. Proceedings of the 2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR), Virtual Event.10.1109/MIPR54900.2022.00069 ↗
27. Alghamdi, J., Lin, Y., and Luo, S. (2022). A Comparative Study of Machine Learning and Deep Learning Techniques for Fake News Detection. Information, 13.10.3390/info13120576 ↗
28. Ruchansky, N., Seo, S., and Liu, Y. (2017, January 6–10). Csi: A hybrid deep model for fake news detection. Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, Singapore.
29. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
30. Bidirectional LSTM with attention mechanism and convolutional layer for text classification10.1016/j.neucom.2019.01.078 ↗
31. Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv.10.3115/v1/D14-1179 ↗
32. An attentive survey of attention models10.1145/3465055 ↗
33. Sardelich, M., and Manandhar, S. (2018). Multimodal deep learning for short-term stock volatility prediction. arXiv.
34. Kim, Y. (2014). Convolutional Neural Networks for Sentence Classification. arXiv.10.3115/v1/D14-1181 ↗
35. Liu, J., Wang, X., Tan, Y., Huang, L., and Wang, Y. (2022). An Attention-Based Multi-Representational Fusion Method for Social-Media-Based Text Classification. Information, 13.10.3390/info13040171 ↗
36. Fake News Detection on Social Media Using A Natural Language Inference Approach10.1007/s11042-022-12428-8 ↗
37. Koloski, B., Stepišnik-Perdih, T., Robnik-Šikonja, M., Pollak, S., and Škrlj, B. (2021). Knowledge Graph informed Fake News Classification via Heterogeneous Representation Ensembles. arXiv.10.1016/j.neucom.2022.01.096 ↗
38. Exploring N-gram, word embedding and topic models for content-based fake news detection in FakeNewsNet evaluation
39. Shu, K., Wang, S., and Liu, H. (2019, January 11–15). Beyond news contents: The role of social context for fake news detection. Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, Melbourne, Australia.10.1145/3289600.3290994 ↗