Comparative Analysis on Different Deepfake Detection Techniques

Ashutosh Sharma; Aryan Dutt; Arpit Rastogi; Avinash Ratre

doi:10.34256/ijcci2512

Ashutosh Sharma Department of Electronics & Communication Engineering, Delhi Technological University, India
Aryan Dutt Department of Electronics & Communication Engineering, Delhi Technological University, India
Arpit Rastogi Department of Electronics & Communication Engineering, Delhi Technological University, India
Avinash Ratre Department of Electronics & Communication Engineering, Delhi Technological University, India

Keywords: Deepak, CNN, Transformer, AUC, ViT, Dataset

Abstract

Advancements in deep learning have led to the emergence of highly realistic AI-generated videos known as deepfakes. These videos utilize generative models to expertly modify facial features, creating convincingly altered identities or expressions. Despite their complexity, deepfakes pose significant threats by potentially misleading or manipulating individuals, which can undermine trust and have repercussions on legal, political, and social frameworks. To address these challenges, researchers are actively developing strategies to detect deepfake content, essential for safeguarding privacy and combating the spread of manipulated media. This article explores current methods for generating deepfake images and videos, with a focus on facial features and expression alterations. It also provides an overview of publicly available deepfake datasets, crucial for developing and evaluating detection systems. Additionally, the research examines the challenges associated with identifying deepfake face swaps and expression changes, while proposing future research directions to overcome these hurdles. By offering guidance to researchers, the document aims to foster the development of robust solutions for deepfake detection, contributing to the preservation of the integrity and reliability of visual media.

Metrics

Metrics Loading ...

References

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, Y. Bengio, Generative adversarial nets. Advances in neural information processing systems, (2014) 27.

D.P. Kingma, M. Welling, (2013). Auto-encoding variational bayes. arXiv preprint,

Y. Choi, M. Choi, M. Kim, J.W. Ha, S. Kim, J. Choo (2018). Stargan: Unified generative adversarial networks for multi-domain image-to-image translation. In Proceedings of the IEEE conference on computer vision and pattern recognition, IEEE, USA. https://doi.org/10.1109/CVPR.2018.00916

T Kim, M Cha, H Kim, JK Lee, J Kim, Learning to discover cross-domain relations with generative adversarial networks. International Conference on Machine Learning, PMLR, (2017) 1857–1865.

J. Chai, H. Zeng, A. Li, E.W. Ngai, (2021). Deep learning in computer vision: A critical review of emerging techniques and application scenarios. Machine Learning with Applications, 6, 100134. https://doi.org/10.1016/j.mlwa.2021.100134

X. Yang, Y. Li, S. Lyu, (2019). Exposing deep fakes using inconsistent head poses. ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), IEEE, UK. https://doi.org/10.1109/ICASSP.2019.8683164

P. Zhou, X. Han, V.I. Morariu, L.S. Davis, (2017). Two-stream neural networks for tampered face detection. In 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), IEEE. USA. https://doi.org/10.1109/CVPRW.2017.229

A. Rossler, D. Cozzolino, L. Verdoliva, C. Riess, J. Thies, M. Nießner, (2019). Faceforensics++: Learning to detect manipulated facial images. In Proceedings of the IEEE/CVF International Conference on Computer Vision, IEEE, Korea (South). https://doi.org/10.1109/ICCV.2019.00009

Z Li, F Liu, W Yang, S Peng, J Zhou, A survey of convolutional neural networks: analysis, applications, and prospects. IEEE Transactions on Neural Networks and Learning Systems, 33(12), (2021) 6999-7019. https://doi.org/10.1109/TNNLS.2021.3084827

D Wodajo, S Atnafu, (2021) Deepfake video detection using convolutional vision transformer. arXiv preprint.

P. Korshunov, S. Marcel, Deepfakes: a new threat to ace recognition? Assessment and detection. arXiv preprint.

B. Dolhansky, J. Bitton, B. Pflaum, J. Lu, R. Howes, M. Wang, C. C. Ferrer, (2020). The deepfake detection challenge (DFDC) dataset. arXiv preprint.

L. Jiang, R. Li, W. Wu, C. Qian, C.C. Loy, (2020). Deeperforensics-1.0: A large-scale dataset for real-world face forgery detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, USA. https://doi.org/10.1109/CVPR42600.2020.00296

M. Tan, Q. Le, (2019). Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning. PMLR.

Z. Chen, P.H. Ho, (2019). Global-connected network with generalized ReLU activation. Pattern Recognition, 96, 106961. https://doi.org/10.1016/j.patcog.2019.07.006

C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition.