Adaptive Gated Deepfake Detection for Low-Resolution and Resource-Constrained Environments

TL;DR

AdaGate-DF achieves efficient deepfake detection in low-resolution settings with AUC of 0.9370 on Celeb-DF.

cs.CV 🔴 Advanced 2026-09-05 96 views
Vaishnavi Sen Cody Laurie Rashida Hasan
deepfake detection adaptive inference low resolution frequency-domain analysis uncertainty estimation

Key Findings

Methodology

AdaGate-DF employs a dual-branch architecture combining RGB and DCT features with a multi-exit inference mechanism that adapts the inference path based on image quality cues, reducing computational resource usage.

Key Results

  • On the Celeb-DF dataset, AdaGate-DF achieves an AUC of 0.9370, outperforming MaD-CoRN and DefakeHop++ while maintaining low inference latency.
  • At 384×384 resolution, the AUC reaches 0.9708, demonstrating performance improvement with increased resolution.
  • On the FF++ dataset, AdaGate-DF remains effective under class imbalance, showing competitive results with evaluated models.

Significance

AdaGate-DF holds significant implications for academia and industry, providing an efficient deepfake detection solution in resource-constrained environments. It addresses the shortcomings of traditional methods in low-resolution scenarios.

Technical Contribution

AdaGate-DF distinguishes itself from existing methods through its adaptive inference mechanism and the integration of frequency-domain features, offering new engineering possibilities, especially in resource-limited settings.

Novelty

AdaGate-DF is the first to combine RGB and frequency-domain features for adaptive inference, significantly enhancing detection performance on low-quality inputs compared to existing methods.

Limitations

  • In the imbalanced FF++ dataset, despite good AUC performance, there may still be a risk of bias towards the majority class.
  • Performance may degrade in extremely low-resolution scenarios.

Future Work

Future research can explore generalization capabilities across more datasets and performance optimization in real-time applications.

AI Executive Summary

Deepfake detection is crucial for digital forensics and media verification, yet existing models perform poorly in low-resolution and resource-constrained environments. AdaGate-DF offers an efficient solution by combining RGB and DCT features with an adaptive inference mechanism.

This framework routes samples based on quality features, allowing high-quality images to exit early, saving computational resources. On the Celeb-DF dataset, AdaGate-DF achieves an AUC of 0.9370, demonstrating exceptional performance.

While it performs well on the FF++ dataset, caution is needed under class imbalance conditions. Future work will focus on enhancing generalization capabilities and optimizing performance in real-time applications.

Deep Analysis

Background

With the rapid advancement of generative models, deepfake technology has made manipulated facial media increasingly realistic and difficult to distinguish from authentic content. Consequently, deepfake detection has become a major issue for digital forensics and media verification. Benchmark datasets like FaceForensics++ and Celeb-DF have supported standardized evaluation in this area. Despite progress, detecting deepfakes under low-resolution and resource-constrained conditions remains challenging.

Core Problem

Deepfake detection models often rely on high-quality inputs, fixed inference paths, and computationally expensive architectures, limiting their use in low-resolution and resource-constrained settings. In real-world scenarios, images and video frames are often compressed, resized, blurred, or captured at inconsistent resolutions, which can reduce or distort fine-grained facial artifacts useful for detecting manipulation.

Innovation

AdaGate-DF combines RGB and frequency-domain features with an adaptive inference mechanism, significantly improving detection performance on low-quality inputs. By routing based on quality features, it allows high-quality images to exit early, saving computational resources. This approach is innovative compared to existing methods, especially in resource-limited environments.

Methodology

  • �� AdaGate-DF employs a dual-branch architecture combining RGB and DCT features.
  • �� Utilizes a multi-exit inference mechanism that adapts the inference path based on image quality cues.
  • �� Routes samples based on quality features, reducing computational resource usage.
  • �� Evaluated on Celeb-DF and FF++ datasets, comparing performance with existing methods.

Experiments

Experiments were conducted on Celeb-DF and FF++ benchmark datasets to evaluate performance under different input resolutions. Baselines include MaD-CoRN, DefakeHop++, and ShuffleNetV2. Key evaluation metrics include AUC, accuracy, precision, recall, and F1-score.

Results

On the Celeb-DF dataset, AdaGate-DF achieves an AUC of 0.9370, outperforming MaD-CoRN and DefakeHop++ while maintaining low inference latency. At 384×384 resolution, the AUC reaches 0.9708, demonstrating performance improvement with increased resolution. On the FF++ dataset, AdaGate-DF remains effective under class imbalance, showing competitive results with evaluated models.

Applications

AdaGate-DF is applicable in scenarios such as digital forensics, media verification, and maintaining online trust, especially in resource-constrained environments. Its adaptive inference mechanism makes it more efficient in processing large volumes of images and video frames.

Limitations & Outlook

In the imbalanced FF++ dataset, despite good AUC performance, there may still be a risk of bias towards the majority class. Performance may degrade in extremely low-resolution scenarios. Future research can explore generalization capabilities across more datasets and performance optimization in real-time applications.

Plain Language Accessible to non-experts

Imagine you're in a factory with different production lines to handle materials of varying quality. High-quality materials can go through a fast track, saving time and resources, while low-quality materials need more processing steps to ensure the final product's quality. This is similar to how AdaGate-DF works; it analyzes the quality features of an image to decide which 'production line' it should take, thus improving efficiency. This method is particularly useful in scenarios where large volumes of images need to be processed quickly, such as video moderation on social media.

ELI14 Explained like you're 14

Imagine you're playing a game with different difficulty levels. Easy levels you can breeze through quickly, but hard levels require more time and effort to solve. AdaGate-DF is like this game; it decides how fast to process each picture based on its 'difficulty.' If the picture is high quality, it gets processed quickly; if it's low quality, it takes more time to analyze. This method makes it both fast and accurate when dealing with lots of pictures!

Glossary

AdaGate-DF (Adaptive Gated Deepfake Detection)

A deepfake detection framework combining RGB and frequency-domain features, using adaptive inference to improve efficiency on low-quality inputs.

Applied in low-resolution and resource-constrained environments.

AUC (Area Under the Curve)

A metric for evaluating the performance of classification models; higher values indicate better models.

Used to assess AdaGate-DF's performance on Celeb-DF and FF++ datasets.

DCT (Discrete Cosine Transform)

A technique for converting spatial domain signals to frequency domain, commonly used in image processing.

Used to extract frequency-domain features to enhance deepfake detection.

MaD-CoRN (Convolutional Reservoir Network)

A lightweight deepfake detection method based on convolutional reservoir networks.

Used as one of the baseline models for performance comparison.

ShuffleNetV2

An efficient CNN architecture designed for low-latency inference.

Used as one of the baseline models for performance comparison.

Open Questions Unanswered questions from this research

  • 1 How to maintain high detection performance in extremely low-resolution scenarios? Existing methods may fail in such cases, requiring new strategies.
  • 2 How to avoid bias towards the majority class in imbalanced datasets? More effective balancing strategies are needed.

Applications

Immediate Applications

Social Media Moderation

AdaGate-DF can be used to quickly moderate video content on social media platforms, ensuring its authenticity. Suitable for platforms that need to process large volumes of content quickly.

Long-term Vision

Real-time Video Surveillance

In the future, AdaGate-DF could be used in real-time video surveillance systems to detect and prevent the spread of deepfake videos.

Abstract

Deepfake detection models often rely on high-quality inputs, fixed inference paths, and computationally expensive architectures, limiting their use in low-resolution and resource-constrained settings. This paper proposes AdaGate-DF, an adaptive gated deepfake detection framework that uses image-quality cues to route samples through a dual multi-exit system so high-quality images can exit earlier and save compute. We evaluated AdaGate-DF against MaD-CoRN, DefakeHop++, and ShuffleNetV2 on two benchmark datasets (Celeb-DF and FaceForensics++) under multiple configurations to test image resolution dependence and training and inference efficiency. On Celeb-DF, AdaGate-DF achieves an AUC of 0.9370, outperforming MaD-CoRN and DefakeHop++ while maintaining a low inference latency. Resolution-based testing shows consistent improvement as input resolution increases, reaching an AUC of 0.9708 at 384 by 384. The FaceForensics++ results highlight that AdaGate-DF remains effective under class imbalance, following competitive results with evaluated models. Overall, AdaGate-DF demonstrated a practical balance between detection performance, uncertainty-aware prediction, and computational efficiency for variable-quality deepfake detection.

cs.CV cs.LG