Ternion: An Autonomous Model for Fake News Detection
Source abstract
Abstract
In recent years, the consumption of social media content to keep up with global news and to verify its authenticity has become a considerable challenge. Social media enables us to easily access news anywhere, anytime, but it also gives rise to the spread of fake news, thereby delivering false information. This also has a negative impact on society. Therefore, it is necessary to determine whether or not news spreading over social media is real. This will allow for confusion among social media users to be avoided, and it is important in ensuring positive social development. This paper proposes a novel solution by detecting the authenticity of news through natural language processing techniques. Specifically, this paper proposes a novel scheme comprising three steps, namely, stance detection, author credibility verification, and machine learning-based classification, to verify the authenticity of news. In the last stage of the proposed pipeline, several machine learning techniques are applied, such as decision trees, random forest, logistic regression, and support vector machine (SVM) algorithms. For this study, the fake news dataset was taken from Kaggle. The experimental results show an accuracy of 93.15%, precision of 92.65%, recall of 95.71%, and F1-score of 94.15% for the support vector machine algorithm. The SVM is better than the second best classifier, i.e., logistic regression, by 6.82%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Misinformation and Its Impacts · Spam and Phishing Detection · Sentiment Analysis and Opinion Mining
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, Iqra University, Karachi 76400, Pakistan
College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
Department of Computer Science, NED University of Engineering and Technology, Karachi 76400, Pakistan
Funding
Deputy for Research and 311 Innovation- Ministry of Education, Kingdom of Saudi Arabia
References (48)
Show source-provided references
1. De Beer, D., and Matthee, M. (2020). Approaches to identify fake news: A systematic literature review. International Conference on Integrated Science, Cambodia, Springer.10.1007/978-3-030-49264-9_2 ↗
2. Sitaula, N., Mohan, C.K., Grygiel, J., Zhou, X., and Zafarani, R. (2020). Credibility-based fake news detection. Disinformation, Misinformation, and Fake News in Social Media, Springer.10.1007/978-3-030-42699-6_9 ↗
3. Goldani, M.H., Momtazi, S., and Safabakhsh, R. (2021). Detecting fake news with capsule neural networks. Appl. Soft Comput., 101.10.1016/j.asoc.2020.106991 ↗
4. Automating fake news detection system using multi-level voting model10.1007/s00500-019-04436-y ↗
5. Bühler, J., Murawski, M., Darvish, M., and Bick, M. (2020). Developing a Model to Measure Fake News Detection Literacy of Social Media Users. Disinformation, Misinformation, and Fake News in Social Media, Springer.10.1007/978-3-030-42699-6_11 ↗
6. EchoFakeD: Improving fake news detection in social media with an efficient deep neural network10.1007/s00521-020-05611-1 ↗
7. FakeBERT: Fake news detection in social media with a BERT-based deep learning approach10.1007/s11042-020-10183-2 ↗
8. Paka, W.S., Bansal, R., Kaushik, A., Sengupta, S., and Chakraborty, T. (2021). Cross-SEAN: A cross-stitch semi-supervised neural attention model for COVID-19 fake news detection. Appl. Soft Comput., 107.10.1016/j.asoc.2021.107393 ↗
9. Saxena, A., Saxena, P., and Reddy, H. (2022). Fake News Detection Techniques for Social Media. Principles of Social Networking, Springer.10.1007/978-981-16-3398-0_15 ↗
10. Mohammad, S., Kiritchenko, S., Sobhani, P., Zhu, X., and Cherry, C. (2016, January 16–17). Semeval-2016 task 6: Detecting stance in tweets. Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), San Diego, CA, USA.10.18653/v1/S16-1003 ↗
11. Riedel, B., Augenstein, I., Spithourakis, G.P., and Riedel, S. (2017). A simple but tough-to-beat baseline for the Fake News Challenge stance detection task. arXiv.
12. Pomerleau, D., and Rao, D. (2021, May 10). Fake News Challenge Stage 1 (fnc-i): Stance Detection. Available online: www.fakenewschallenge.org.
13. Chaudhry, A.K., Baker, D., and Thun-Hohenstein, P. (2017). Stance detection for the fake news challenge: Identifying textual relationships with deep neural nets. CS224n: Natural Language Processing with Deep Learning, Standaford NLP. Available online: http://web.stanford.edu/class/cs224n/.
14. Bhatt, G., Sharma, A., Sharma, S., Nagpal, A., Raman, B., and Mittal, A. Combining neural, statistical and external features for fake news stance identification. Proceedings of the WWW ’18: Companion Proceedings of the The Web Conference 2018.10.1145/3184558.3191577 ↗
15. Bourgonje, P., Schneider, J.M., and Rehm, G. (2017, January 2). From clickbait to fake news detection: An approach based on detecting the stance of headlines to articles. Proceedings of the 2017 EMNLP workshop: Natural Language Processing Meets Journalism, Copenhagen, Denmark.10.18653/v1/W17-4215 ↗
16. N-gram assisted youtube spam comment detection10.1016/j.procs.2018.05.181 ↗
17. Efficient n-gram construction for text categorization using feature selection techniques10.3233/IDA-205154 ↗
18. Saikh, T., Anand, A., Ekbal, A., and Bhattacharyya, P. (2019, January 26–28). A novel approach towards fake news detection: Deep learning augmented with textual entailment features. Proceedings of the 24th International Conference on Applications of Natural Language to Information Systems, NLDB 2019, Salford, UK.10.1007/978-3-030-23281-8_30 ↗
19. Ghanem, B., Rosso, P., and Rangel, F. (2018, January 1). Stance detection in fake news a combined feature representation. Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), Brussels, Belgium.10.18653/v1/W18-5510 ↗
20. Ferreira, W., and Vlachos, A. (2016, January 12–17). Emergent: A novel data-set for stance classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1138 ↗
21. Fake news detection: A deep learning approach
22. Assisting consumers in detecting fake reviews: The role of identity information disclosure and consensus10.1016/j.jretconser.2016.06.002 ↗
23. What drives hyper-partisan news sharing: Exploring the role of source, style, and content
24. Overview of the 8th author profiling task at PAN 2020: Profiling fake news spreaders on Twitter
25. Parikh, S.B., and Atrey, P.K. (2018, January 10–12). Media-rich fake news detection: A survey. Proceedings of the 2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), Miami, FL, USA.10.1109/MIPR.2018.00093 ↗
26. Rumour Stance Classification using A Hybrid of Capsule Network and Multi-Layer Perceptron
27. Ajao, O., Bhowmik, D., and Zargari, S. (2018, January 18–20). Fake news identification on twitter with hybrid cnn and rnn models. Proceedings of the 9th International Conference on Social Media and Society, Copenhagen, Denmark.10.1145/3217804.3217917 ↗
28. Girgis, S., Amer, E., and Gadallah, M. (2018, January 18–19). Deep Learning Algorithms for Detecting Fake News in Online Text. Proceedings of the 2018 13th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt.10.1109/ICCES.2018.8639198 ↗
29. Gilda, S. (2017, January 13–14). Notice of Violation of IEEE Publication Principles: Evaluating machine learning algorithms for fake news detection. Proceedings of the 2017 IEEE 15th Student Conference on Research and Development (SCOReD), Wilayah Persekutuan Putrajaya, Malaysia.10.1109/SCORED.2017.8305411 ↗
30. Ahmed, S., Hinkelmann, K., and Corradini, F. (2019, January 25–27). Combining machine learning with knowledge engineering to detect fake news in social networks-a survey. Proceedings of the AAAI 2019 Spring Symposium, Palo Alto, CA, USA.
31. Library, N. (2021, August 21). Natural Language Toolkit. Available online: https://www.nltk.org/.
32. Kaggle (2021, August 21). Fake news Dataset. Available online: https://www.kaggle.com/c/fake-news/data.
33. Jindal, R., Dahiya, D., Sinha, D., and Garg, A. (2022, January 19–20). A Study of Machine Learning Techniques for Fake News Detection and Suggestion of an Ensemble Model. Proceedings of the International Conference on Innovative Computing and Communications, New Delhi, India.10.1007/978-981-16-3071-2_51 ↗
34. Shrivastava, S., Singh, R., Jain, C., and Kaushal, S. (2022). A Research on Fake News Detection Using Machine Learning Algorithm. Smart Systems: Innovations in Computing, Springer.10.1007/978-981-16-2877-1_25 ↗
35. Monti, F., Frasca, F., Eynard, D., Mannion, D., and Bronstein, M.M. (2019). Fake news detection on social media using geometric deep learning. arXiv.
36. Fake news detection: A hybrid CNN-RNN based deep learning approach
37. Paul, S., Joy, J.I., Sarker, S., Ahmed, S., and Das, A.K. (2019, January 28–30). Fake news detection in social media using blockchain. Proceedings of the 2019 7th International Conference on Smart Computing & Communications (ICSCC), Sarawak, Malaysia.10.1109/ICSCC.2019.8843597 ↗
38. Twitter sentiment analysis on worldwide COVID-19 outbreaks10.24017/covid.8 ↗
39. Helmstetter, S., and Paulheim, H. (2018, January 28–31). Weakly supervised learning for fake news detection on Twitter. Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), Barcelona, Spain.10.1109/ASONAM.2018.8508520 ↗
40. Buntain, C., and Golbeck, J. (2017, January 3–5). Automatically identifying fake news in popular twitter threads. Proceedings of the 2017 IEEE International Conference on Smart Cloud (SmartCloud), New York, NY, USA.10.1109/SmartCloud.2017.40 ↗
41. Gupta, P., Pathak, V., Goyal, N., Singh, J., Varshney, V., and Kumar, S. (2018, January 9–10). Content credibility check on Twitter. Proceedings of the International Conference on Application of Computing and Communication Technologies, New Delhi, India.10.1007/978-981-13-2035-4_18 ↗
42. Twitter, I. (2021, August 21). Twitter API. Available online: https://developer.twitter.com.
43. A Proposed Framework to Analyze Abusive Tweets on the Social Networks10.5815/ijmecs.2018.01.05 ↗
44. Decision tree classifier: A detailed survey
45. Kulkarni, V.Y., and Sinha, P.K. (2012, January 18–20). Pruning of random forest classifiers: A survey and future directions. Proceedings of the 2012 International Conference on Data Science & Engineering (ICDSE), Cochin, India.10.1109/ICDSE.2012.6282329 ↗
46. Data classification with binary response through the Boosting algorithm and logistic regression10.1016/j.eswa.2016.08.014 ↗
47. Machine Learning: ECML-94
48. Desjardins, J. (2021, September 22). What Happens in an Internet Minute in 2018?. 2018., Available online: https://www.visualcapitalist.com/internet-minute-2018.