ARCHIVES

Year 2026 · Volume 6 · Issue 5

Original Article

Multi-Stream Deepfake Video Detection Using Heartbeat Signals and Lip-Sync Verification

Neha Khannum A1 Saniya D2 Sneha K S3 Syeda Asra4 Vinutha D5
1 2 3 4 Department of Information Science and Engineering, Bapuji Institute of Engineering and Technology, Davanagere Karnataka, India. 5 Assistant Professor, Department of Information Science and Engineering, Bapuji Institute of Engineering and Technology, Davanagere Karnataka, India.

Published Online: September-October 2026

Pages: 181-186

Abstract

The rapid development of Artificial Intelligence (AI), deep learning, and generative models has enabled the creation of highly realistic manipulated videos known as deepfakes. These videos can alter facial identities, expressions, and lip movements, creating challenges for digital media authenticity and security. Conventional deepfake detection methods primarily rely on frame-level visual analysis, which may be insufficient when manipulation artifacts are subtle or videos undergo compression and post-processing. This paper proposes a multi-stream deepfake video detection system integrating Convolutional Neural Network–Long Short-Term Memory (CNN-LSTM), remote Photoplethysmography (rPPG), and lip-sync verification. The CNN-LSTM stream extracts spatial facial features and examines temporal inconsistencies across consecutive video frames. The rPPG stream analyzes subtle facial color variations to estimate physiological signals associated with blood-volume changes. The lip-sync verification stream examines the synchronization between audio and mouth movements. The outputs of these streams are intended to be integrated to support deepfake classification. By combining visual, temporal, physiological, and audio-visual evidence, the proposed system aims to provide a more comprehensive approach to deepfake video detection.

Related Articles

2026

Fake Currency Detection Using Deep Learning

2026

Smart E-Commerce System with Dynamic Pricing

2026

Personal Expense Tracker with Currency Converter

2026

Paw Safe: An Extensive Technology-Driven Framework for Stray Dog Rescue, Healthcare Management, Community Engagement, and Smart Urban Governance

2026

Design and Development of a Full-Stack E-Commerce Website

2026

Power quality improvement techniques from a topological perspective: An overview

Share Article

X
LinkedIn
Facebook
WhatsApp

Or copy link

https://www.ijsreat.com/archives/multi-stream-deepfake-video-detection-using-heartbeat-signals-and-lip-sync-verification

*Instagram doesn't support direct link sharing from web. Copy the link and share it in your Instagram story or post.