journal article·2023-10-05Open access

A Survey of Detection and Mitigation for Fake Images on Social Media Platforms

Dilip Kumar Sharma, Bhuvanesh Singh, Saurabh Agarwal, Lalit Garg, Cheonshik Kim, Ki-Hyun Jung

Applied Sciences· Volume 13· Issue 19

Abstract

Recently, the spread of fake images on social media platforms has become a significant concern for individuals, organizations, and governments. These images are often created using sophisticated techniques to spread misinformation, influence public opinion, and threaten national security. This paper begins by defining fake images and their potential impact on society, including the spread of misinformation and the erosion of trust in digital media. This paper also examines the different types of fake images and their challenges for detection. We then review the recent approaches proposed for detecting fake images, including digital forensics, machine learning, and deep learning. These approaches are evaluated in terms of their strengths and limitations, highlighting the need for further research. This paper also highlights the need for multimodal approaches that combine multiple sources of information, such as text, images, and videos. Furthermore, we present an overview of existing datasets, evaluation metrics, and benchmarking tools for fake image detection. This paper concludes by discussing future directions for fake image detection research, such as developing more robust and explainable methods, cross-modal fake detection, and the integration of social context. It also emphasizes the need for interdisciplinary research that combines computer science, digital forensics, and cognitive psychology experts to tackle the complex problem of fake images. This survey paper will be a valuable resource for researchers and practitioners working on fake image detection on social media platforms.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Media Forensic Detection · Misinformation and Its Impacts · Advanced Steganography and Watermarking Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering and Application, GLA University, Mathura 281406, India

Graduate Software Programs, University of St. Thomas, St. Paul, MN 55105, USA

Department of Computer Science and Engineering, Amity School of Engineering Technology, Amity University Uttar Pradesh, Noida 201313, India

Department of Software Convergence, Andong National University, Andong-si 36729, Republic of Korea

Computer Information Systems, Faculty of Information & Communication Technology, University of Malta, 2080 Msida, Malta

Department of Computer Engineering, Sejong University, Seoul 05006, Republic of Korea

Funding

National Research Foundation of Korea · Ministry of Education

References (100+)

Show source-provided references
1. Barthel, M., Mitchell, A., and Holcomb, J. (2020, May 02). Many Americans Believe Fake News Is Sowing Confusion. Available online: https://www.journalism.org/2016/12/15/many-americans-believe-fake-news-is-sowing-confusion/.
2. (2021, January 15). CIGI-Ipsos Global Survey on Internet Security and Trust. Available online: https://www.cigionline.org/internet-survey-2019.
3. Silverman, C. (2020, May 02). This Analysis Shows How Viral Fake Election News Stories Outperformed Real News on Facebook. Available online: https://www.buzzfeednews.com/article/craigsilverman/viral-fake-election-news-outperformed-real-news-on-facebook#.emA15rzd0.
4. Gowen, A. (2020, May 02). As Mob Lynchings Fueled by Whatsapp Messages Sweep India, Authorities Struggle to Combat Fake News. Available online: https://www.washingtonpost.com/world/asia_pacific/as-mob-lynchings-fueled-by-whatsapp-sweep-india-authorities-struggle-to-combat-fake-news/2018/07/02/683a1578-7bba-11e8-ac4e-421ef7165923_story.html.
5. Kudrati, M. (2020, July 10). This Picture of Donald Trump Endorsing PM Modi Is a Hoax. Available online: https://www.boomlive.in/this-picture-of-donald-trump-endorsing-pm-modi-is-a-hoax/.
6. Baynes, C. (2020, July 15). Coronavirus: Patients Refusing Treatment Because of Fake News on Social Media, NHS Staff Warn. Available online: https://www.independent.co.uk/news/uk/home-news/coronavirus-fake-news-conspiracy-theories-antivax-5g-facebook-twitter-a9549831.html.
7. Stoll, J. (2020, May 02). Reading Fake News about the Coronavirus in Norway 2020, by Source. Available online: https://www.statista.com/statistics/1108710/reading-fake-news-about-the-coronavirus-in-norway-by-source/.
8. Unnikrishnan, D. (2020, July 10). Photo of PM Narendra Modi Bowing to Xi Jinping Is Morphed. Available online: https://www.boomlive.in/fake-news/photo-of-pm-narendra-modi-bowing-to-xi-jinping-is-morphed-8579.
9. Alteration of Photos Raise Host of Legal, Ethical Issues
10. Jaffe, J. (2020, July 10). Dubya, Willya Turn the Book Over. Available online: https://www.wired.com/2002/11/dubya-willya-turn-the-book-over/.
11. Mishra, M., and Adhikary, M.C. (2013). Digital Image Tamper Detection Techniques—A Comprehensive Study. arXiv.
12. Mandankandy, A.A. (2017, January 17–18). Image forgery and its detection: A survey. Proceedings of the International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), Coimbatore, India.
13. Parikh, S.B., and Atrey, P.K. (2018, January 10–12). Media-Rich Fake News Detection: A Survey. Proceedings of the IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), Miami, FL, USA.10.1109/MIPR.2018.00093 ↗
14. Deepfakes and beyond: A Survey of face manipulation and fake detection10.1016/j.inffus.2020.06.014 ↗
15. Robust and effective multiple copy-move forgeries detection and localization10.1007/s10044-021-00968-y ↗
16. Copy-move forgery detection using integrated DWT and SURF
17. Jwaid, M.F., and Baraskar, T.N. (2017, January 10–11). Study and analysis of copy-move & splicing image forgery detection techniques. Proceedings of the 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India.10.1109/I-SMAC.2017.8058268 ↗
18. Huh, M., Liu, A., Owens, A., and Efros, A.A. (2018, January 8–14). Fighting Fake News: Image Splice Detection via Learned Self-Consistency. Proceedings of the Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01252-6_7 ↗
19. Vadsola, M. (2020, May 10). The Math behind GANs (Generative Adversarial Networks). Available online: https://towardsdatascience.com/the-math-behind-gans-generative-adversarial-networks-3828f3469d9c.
20. Vincent, J. (2020, July 10). Facebook’s Problems Moderating Deepfakes Will Only Get Worse in 2020. Available online: https://www.theverge.com/2020/1/15/21067220/deepfake-moderation-apps-tools-2020-facebook-reddit-social-media.
21. A comprehensive evaluation procedure for copy-move forgery detection methods: Results from a systematic review10.1007/s11042-022-12010-2 ↗
22. Fridrich, J., Soukal, D., and Lukas, J. (2003, January 6–8). Detection of copy-move forgery in digital images. Proceedings of the Digital Forensic Research Workshop, Cleveland, OH, USA.
23. Popescu, A.C., and Farid, H. (2004). Exposing Digital Forgeries by Detecting Duplicated Image Regions, Department of Computer Science, Dartmouth College.
24. Li, G., Wu, Q., Tu, D., and Sun, S. (2007, January 2–5). A Sorted Neighborhood Approach for Detecting Duplicated Regions in Image Forgeries Based on DWT and SVD. Proceedings of the 2007 IEEE International Conference on Multimedia and Expo, Beijing, China.10.1109/ICME.2007.4285009 ↗
25. Bayram, S., Sencar, H.T., and Memon, N. (2009, January 19–24). An efficient and robust method for detecting copy-move forgery. Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan.10.1109/ICASSP.2009.4959768 ↗
26. Gul, G., Avcibas, I., and Kurugollu, F. (2010, January 26–29). SVD based image manipulation detection. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.10.1109/ICIP.2010.5652854 ↗
27. Improved DCT-based detection of copy-move forgery in images10.1016/j.forsciint.2010.08.001 ↗
28. An efficient scheme for detecting copy-move forged images by local binary patterns
29. Detection of copy–move image forgery using histogram of orientated gradients10.1016/j.ins.2015.03.009 ↗
30. Evaluation of Image Forgery Detection Using Multi-Scale Weber Local Descriptors10.1142/s0218213015400163 ↗
31. Copy-Move Forgery Detection Technique for Forensic Analysis in Digital Images10.1155/2016/8713202 ↗
32. Fractional Quaternion Zernike Moments for Robust Color Image Copy-Move Forgery Detection10.1109/ACCESS.2018.2871952 ↗
33. A fast technique to detect copy-move image forgery with reflection and non-affine transformation attacks10.1016/j.eswa.2021.115282 ↗
34. Identification of copy-move and splicing based forgeries using advanced SURF and revised template matching10.1007/s11042-021-10810-6 ↗
35. Tanaka, M., Shiota, S., and Kiya, H. (2021). A Detection Method of Operated Fake-Images Using Robust Hashing. J. Imaging, 7.10.3390/jimaging7080134 ↗
36. A novel copy-move forgery detection algorithm via two-stage filtering10.1016/j.dsp.2021.103032 ↗
37. Ciratefi based copy move forgery detection on digital images10.1007/s11042-021-11503-w ↗
38. Copy-move forgery detection of digital images using football game optimization10.1080/00450618.2020.1811376 ↗
39. A Novel Copy-Move Forgery Detection Algorithm via Feature Label Matching and Hierarchical Segmentation Filtering10.1016/j.ipm.2021.102783 ↗
40. Ng, T., and Chang, S. (2004, January 24–27). A model for image splicing. Proceedings of the IEEE International Conference on Image Processing (ICIP), Singapore.
41. Exposing digital forgeries in color filter array interpolated images10.1109/TSP.2005.855406 ↗
42. Image splicing detection using 2-D phase congruency and statistical moments of characteristic function
43. Wang, W., Dong, J., and Tan, T. (2009, January 7–10). Effective image splicing detection based on image chroma. Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.
44. Zhao, X., Li, J., Li, S., and Wang, S. (2010, January 1–3). Detecting Digital Image Splicing in Chroma Spaces. Proceedings of the Digital Watermarking: 9th International Workshop, IWDW 2010, Seoul, Republic of Korea.
45. Identifying Image Composites Through Shadow Matte Consistency10.1109/TIFS.2011.2139209 ↗
46. Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts10.1109/TIFS.2012.2202227 ↗
47. Digital image splicing detection based on Markov features in DCT and DWT domain10.1016/j.patcog.2012.05.014 ↗
48. Mazumdar, A., and Bora, P.K. (2016, January 18–22). Exposing splicing forgeries in digital images through dichromatic plane histogram discrepancies. Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image Processing, Guwahati, India.10.1145/3009977.3010032 ↗
49. Moghaddasi, Z., Jalab, H.A., and Noor, R.M. (2017, January 22–23). Image splicing detection using singular value decomposition. Proceedings of the Second International Conference on Internet of things, Data and Cloud Computing, Cambridge, UK.10.1145/3018896.3036383 ↗
50. Image splicing detection based on Markov features in discrete octonion cosine transform domain10.1049/iet-ipr.2017.1131 ↗
51. A technique for image splicing detection using hybrid feature set10.1007/s11042-019-08480-6 ↗
52. Color noise correlation-based splicing detection for image forensics10.1007/s11042-020-10326-5 ↗
53. Image Forensic Investigation Using Discrete Cosine Transform-Based Approach10.1007/s11277-021-08396-1 ↗
54. Image splicing detection technique based on Illumination-Reflectance model and LBP10.1007/s11042-020-09707-7 ↗
55. A novel pixel’s fractional mean-based image enhancement algorithm for better image splicing detection10.1016/j.jksus.2021.101805 ↗
56. Agrawal, S., Kumar, P., Seth, S., Parag, T., Singh, M., and Babu, V. (2022, January 19–20). SISL: Self-Supervised Image Signature Learning for Splicing Detection & Localization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Work-Shops, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00012 ↗
57. ET: Edge-Enhanced Transformer for Image Splicing Detection10.1109/LSP.2022.3172617 ↗
58. Exposing digital forgeries by detecting traces of resampling10.1109/TSP.2004.839932 ↗
59. Fillion, C., and Sharma, G. (2010). Media Forensics and Security II, SPIE.
60. Digital image forgery detection and estimation by exploring basic image manipulations10.1016/j.diin.2011.06.004 ↗
61. Fast and effective Keypoint-based image copy-move forgery detection using complex-valued moment invariants10.1016/j.jvcir.2021.103068 ↗
62. Identification of bitmap compression history: JPEG detection and quantizer estimation10.1109/TIP.2002.807361 ↗
63. Krawetz, N. (2020, May 10). A Picture’s Worth… Hacker Factor Solutions. Available online: https://www.hackerfactor.com/papers.
64. Zhang, J., Wang, H., and Su, Y. (2008, January 21–22). Detection of Double-Compression in JPEG2000 Images. Proceedings of the 2008 Second International Symposium on Intelligent Information Technology Application, Shanghai, China.10.1109/IITA.2008.83 ↗
65. Fast, automatic and fine-grained tampered JPEG image detection via DCT coefficient analysis10.1016/j.patcog.2009.03.019 ↗
66. Learning JPEG Compression Artifacts for Image Manipulation Detection and Localization10.1007/s11263-022-01617-5 ↗
67. McCloskey, S., and Albright, M. (2018). Detecting Gan-Generated Imagery Using Color Cues. arXiv.10.1109/ICIP.2019.8803661 ↗
68. Detecting GAN generated Fake Images using Co-occurrence Matrices
69. Matern, F., Riess, C., and Stamminger, M. (2019, January 7–11). Exploiting visual artifacts to expose deepfakes and face manipulations. Proceedings of the 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), Waikoloa Village, HI, USA.10.1109/WACVW.2019.00020 ↗
70. Li, Y., Chang, M.-C., and Lyu, S. (2018, January 11–13). In Ictu Oculi: Exposing AI Created Fake Videos by Detecting Eye Blinking. Proceedings of the 2018 IEEE International Workshop on Information Forensics and Security (WIFS), Hong Kong, China.10.1109/WIFS.2018.8630787 ↗
71. Zhang, W., Zhao, C., and Li, Y. (2020). A Novel Counterfeit Feature Extraction Technique for Exposing Face-Swap Images Based on Deep Learning and Error Level Analysis. Entropy, 22.10.3390/e22020249 ↗
72. PRRNet: Pixel-Region relation network for face forgery detection10.1016/j.patcog.2021.107950 ↗
73. Sunstein, C.R. (2014). On Rumors: How Falsehoods Spread, Why We Believe Them, and What Can Be Done, Princeton University Press.10.1515/9781400851225 ↗
74. Jin, Z., Cao, J., Luo, J., and Zhang, Y. (2016). Image credibility analysis with effective domain transferred deep networks. arXiv.
75. Fake News Detection on Social Media10.1145/3137597.3137600 ↗
76. Ghanem, B., Ponzetto, S.P., and Rosso, P. (2020, January 14–16). FacTweet: Profiling Fake News Twitter Accounts. Proceedings of the International Conference on Statistical Language and Speech Processing, Cardiff, UK.10.1007/978-3-030-59430-5_3 ↗
77. PRNU-based Image Forgery Localization with Deep Multi-scale Fusion10.1145/3548689 ↗
78. Xie, X., Liu, Y., de Rijke, M., He, J., Zhang, M., and Ma, S. (2018, January 5–9). Why People Search for Images using Web Search Engines. Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining, Los Angeles, CA, USA.10.1145/3159652.3159686 ↗
79. Xie, X., Mao, J., Liu, Y., de Rijke, M., Shao, Y., Ye, Z., Zhang, M., and Ma, S. (2019, January 13–17). Grid-based Evaluation Metrics for Web Image Search. Proceedings of the The World Wide Web Conference (WWW 2019), San Francisco, CA, USA.10.1145/3308558.3313514 ↗
80. Gaikwad, M., and Hoeber, O. (2019, January 10–14). An Interactive Image Retrieval Approach to Searching for Images on Social Media. Proceedings of the Conference on Human Information Interaction and Retrieval (CHIIR, 2019), Glasgow, UK.10.1145/3295750.3298930 ↗
81. Detection and veracity analysis of fake news via scrapping and authenticating the web search10.1016/j.cogsys.2019.07.004 ↗
82. Gupta, A., Lamba, H., Kumaraguru, P., and Joshi, A. (2013, January 13–17). Faking Sandy: Characterizing and identifying fake images on Twitter during Hurricane Sandy. Proceedings of the 22nd International Conference on World Wide Web, Rio de Janeiro, Brazil.10.1145/2487788.2488033 ↗
83. Deep spatial–temporal structure learning for rumor detection on Twitter10.1007/s00521-020-05236-4 ↗
84. Image splicing forgery detection using simplified generalized noise model10.1016/j.image.2022.116785 ↗
85. Novel Visual and Statistical Image Features for Microblogs News Verification10.1109/TMM.2016.2617078 ↗
86. Xu, Z., Li, S., and Deng, W. (2015, January 3–6). Learning temporal features using LSTM-CNN architecture for face anti-spoofing. Proceedings of the 3rd Asian Conference on Pattern Recognition, Kuala Lumpur, Malaysia.10.1109/ACPR.2015.7486482 ↗
87. Bayar, B., and Stamm, M.C. (2016, January 20–22). A deep learning approach to universal image manipulation detection using a new convolutional layer. Proceedings of the 4th ACM Workshop on Information Hiding and Multimedia Security, Vigo, Spain.10.1145/2909827.2930786 ↗
88. Rao, Y., and Ni, J. (2016, January 4–7). A deep learning approach to detection of splicing and copy-move forgeries in images. Proceedings of the 2016 IEEE International Workshop on Information Forensics and Security (WIFS), Abu Dhabi, United Arab Emirates.10.1109/WIFS.2016.7823911 ↗
89. Multi-semantic CRF-based attention model for image forgery detection and localization10.1016/j.sigpro.2021.108051 ↗
90. Image Splicing Localization using a Multi-task Fully Convolutional Network (MFCN)10.1016/j.jvcir.2018.01.010 ↗
91. Bappy, J.H., Roy-Chowdhury, A.K., Bunk, J., Nataraj, L., and Manjunath, B. (2017, January 22–29). Exploiting Spatial Structure for Localizing Manipulated Image Regions. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.532 ↗
92. Zhou, P., Han, X., Morariu, V.I., and Davis, L.S. (2018, January 18–22). Learning Rich Features for Image Manipulation Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00116 ↗
93. LiveNet: Improving features generalization for face liveness detection using convolution neural networks10.1016/j.eswa.2018.05.004 ↗
94. Image splicing forgery detection combining coarse to refined convolutional neural network and adaptive clustering10.1016/j.ins.2019.09.038 ↗
95. Wu, Y., Abd-Almageed, W., and Natarajan, P. (2018). Lecture Notes in Computer Science, Springer.
96. Bi, X., Wei, Y., Xiao, B., and Li, W. (2019, January 16–17). RRU-Net: The Ringed Residual U-Net for Image Splicing Forgery Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.10.1109/CVPRW.2019.00010 ↗
97. Exposing splicing forgery in realistic scenes using deep fusion network10.1016/j.ins.2020.03.099 ↗
98. Copy move and splicing forgery detection using deep convolution neural network, and semantic segmentation10.1007/s11042-020-09816-3 ↗
99. An Efficient CNN Model to Detect Copy-Move Image Forgery10.1109/ACCESS.2022.3172273 ↗
100. Deep learning based algorithm (ConvLSTM) for Copy Move Forgery Detection10.3233/JIFS-201192 ↗