A Cross-Modal Neural Architecture for Real-Time Deepfake Detection to Mitigate Misinformation
Main Article Content
Abstract
Deepfake content is spreading quickly online, making it hard to know what’s real. Because of this, we need strong tools that can detect fake images, audio, and videos. In this study, we created a three-step deep learning system that can check all three types of data. In the first step, we used an EfficientNet model to detect fake images. This model is good at noticing tiny details that reveal if an image is fake. After training it with a Kaggle dataset, it reached an accuracy of 95.56%. The second step focuses on fake audio. We have used CNN model to build it which helps the system understand patterns in sound and related facial features. This model was trained on the DEEP-VOICE dataset and achieved 98.5% accuracy.The third step looks at fake videos. In this model we have combinedEfficientNet with an LSTM and a Random Forest classifier. This model helps in both audio and video frames to reach the accuracy of 95.56%. Finally, we combined all three models into one application that can check images, audio, and video in real time. Overall shows that by using multimodel it helps the deep fake to detect the in all the forms.