TwinD: Generalizing Deepfake Detection from Blending to Entire Face Synthesis

This repository contains the TwinD model presented in TwinD: Generalizing Deepfake Detection from Blending to Entire Face Synthesis.

arXiv Badge GitHub Badge

Overview of TwinD: reconstruction and blob twins of a real frame, training pairs of a fake and its real frame, and the mean AUROC on EFS and blending datasets

Video-level AUROC (%) of SOTA methods on 19 datasets sorted by their macro-average (Avg). Above the dataset names are their release years. † A temporal model, which takes several frames as input in a single forward pass.

Blending Blending + EFS EFS
2019 2020 2020 2021 2021 2022 2024 2024 2024 2025 2025 2025 2025 2026 2026 2026 2026 2026 2026
DFD FSh CDFv2 FFIW FAVC DFDM PGF IDF DSv1 HiDF CDFv3 DSv2 RF HF THB OF DFAV MV DF26 Avg
AIGC detectors
Effort-SDv1.4 51.5 58.9 48.8 56.5 55.4 55.3 38.4 63.7 31.6 55.0 63.5 51.5 79.4 75.8 79.6 77.3 48.9 38.6 62.3 57.5
DGS-Net 58.4 71.9 55.4 73.6 45.1 72.8 49.4 38.1 41.5 47.8 71.9 41.7 56.8 66.2 66.0 49.0 68.5 69.8 75.0 58.9
LTD-UFD 83.3 77.2 57.2 72.6 61.9 52.1 60.4 50.9 47.2 64.6 66.2 38.7 64.1 53.2 75.9 30.8 75.1 55.9 87.6 61.8
AlignedFor. 55.0 62.9 61.0 78.3 93.2 65.5 56.8 93.7 43.0 47.8 28.6 74.8 68.8 90.3 93.5 56.9 83.6 40.0 67.8 66.4
DDA 64.4 53.2 55.5 57.5 73.8 51.6 60.2 70.2 71.2 66.8 60.4 84.2 75.4 97.0 85.3 36.5 93.5 71.2 75.1 68.6
B-Free 69.4 69.6 57.1 58.1 79.9 74.6 78.5 75.8 82.0 69.4 59.5 82.7 77.2 98.5 86.2 48.6 91.6 74.8 68.0 73.8
Facial deepfake detectors
SBI 90.2 77.2 87.5 90.9 98.7 99.8 75.0 98.4 63.1 82.1 59.9 59.2 62.1 61.4 71.2 75.9 57.8 43.3 60.1 74.4
FSFM 90.8 72.2 90.5 78.4 90.9 96.8 85.8 82.5 83.5 91.9 79.6 69.0 66.2 72.1 47.4 49.5 74.2 62.7 52.6 75.6
ForAda 98.1 81.3 95.5 92.8 93.1 97.3 87.3 90.7 83.0 91.6 75.6 73.3 69.5 57.5 60.2 65.1 73.1 65.7 56.5 79.3
Effort 96.6 91.3 93.4 95.1 92.4 98.1 86.8 96.0 83.2 90.9 78.7 65.3 64.8 62.6 73.1 75.4 72.5 57.1 44.0 79.9
DFD-FCG† 94.7 91.8 94.0 94.0 90.6 99.6 78.5 92.8 82.7 94.6 93.1 78.5 64.5 65.6 75.3 76.0 65.2 65.4 53.0 81.6
VLAForge 98.1 92.9 95.0 96.8 94.5 99.5 89.7 97.6 87.0 93.9 72.4 70.0 69.0 57.9 77.2 71.7 74.0 62.8 54.3 81.8
FS-VFM 97.8 80.7 94.4 92.0 97.4 98.4 90.8 94.7 92.3 97.3 85.0 79.5 74.6 77.7 61.9 67.3 81.7 60.1 57.7 83.2
DFD-HR 98.7 92.9 94.2 98.0 98.7 99.7 94.6 98.7 90.7 96.3 81.6 83.2 67.5 59.6 81.2 74.8 86.3 80.8 63.4 86.4
GenD-PE 98.6 88.3 95.9 95.4 97.5 98.8 94.3 98.0 89.8 93.7 89.9 78.5 76.6 75.3 83.7 72.3 85.1 79.8 69.7 87.4
TwinD 98.9 96.8 97.1 98.9 99.9 99.9 97.3 99.5 93.5 98.7 90.4 92.1 92.3 96.1 98.5 94.9 93.7 95.0 95.8 96.3
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yermandy/TwinD

Finetuned
(3)
this model

Collection including yermandy/TwinD

Paper for yermandy/TwinD