ARCHIVES
Year 2026 · Volume 6 · Issue 5
Multi-Stream Deepfake Video Detection Using Heartbeat Signals and Lip-Sync Verification
Published Online: September-October 2026
Pages: 181-186
Cite this article
↗ https://www.doi.org/10.59256/ijsreat.20260605019Abstract
The rapid development of Artificial Intelligence (AI), deep learning, and generative models has enabled the creation of highly realistic manipulated videos known as deepfakes. These videos can alter facial identities, expressions, and lip movements, creating challenges for digital media authenticity and security. Conventional deepfake detection methods primarily rely on frame-level visual analysis, which may be insufficient when manipulation artifacts are subtle or videos undergo compression and post-processing. This paper proposes a multi-stream deepfake video detection system integrating Convolutional Neural Network–Long Short-Term Memory (CNN-LSTM), remote Photoplethysmography (rPPG), and lip-sync verification. The CNN-LSTM stream extracts spatial facial features and examines temporal inconsistencies across consecutive video frames. The rPPG stream analyzes subtle facial color variations to estimate physiological signals associated with blood-volume changes. The lip-sync verification stream examines the synchronization between audio and mouth movements. The outputs of these streams are intended to be integrated to support deepfake classification. By combining visual, temporal, physiological, and audio-visual evidence, the proposed system aims to provide a more comprehensive approach to deepfake video detection.
Related Articles
2026
Fake Currency Detection Using Deep Learning
2026
Smart E-Commerce System with Dynamic Pricing
2026
Personal Expense Tracker with Currency Converter
2026
Paw Safe: An Extensive Technology-Driven Framework for Stray Dog Rescue, Healthcare Management, Community Engagement, and Smart Urban Governance
2026
Design and Development of a Full-Stack E-Commerce Website
2026