Papers
arxiv:2611.04634

VeriSpoof: Beyond Real or Fake with One Audio LLM

Published on Nov 3
Ā· Submitted by
Yang Xiao
on Nov 5
Authors:
,

Abstract

VeriSpoof is an audio language model that unifies deepfake detection, generator attribution, source verification, and evidence-based rationale generation with minimal parameter updates.

A speech deepfake detector estimates whether a recording is synthetic, but a forensic analyst also asks which system produced it, whether recordings share a source, and what evidence supports each conclusion. We present VeriSpoof, an audio language model that unifies five tasks with shared weights: deepfake detection, generator attribution (generator, acoustic model and vocoder), recording-condition analysis, synthesized-span localisation, and source verification. Each decision is supported by grounded rationales whose statements can be independently verified. Answers are scored by sentence likelihood, allowing detection and source verification to be thresholded without separate heads. Rationale statements can be checked against waveform measurements, span labels, or generator metadata. Counterfactual examples train decisions to follow the stated evidence. Across the 14 Speech-DF-Arena test sets, VeriSpoof-Plus achieves 2.14% pooled EER, ranking third of 28 systems and first among open-weight systems. VeriSpoof-Base, trained only on official training splits of eight corpora, achieves 4.43% EER, less than half that of the next open-weight detector. With the same weights, VeriSpoof-Plus verifies whether recordings from generators unseen in training share a source at 6.2% EER. Controlled studies show that the audio representation governs detection, the LLM governs recording comparison, and source supervision is necessary for neural-codec fakes. Statement-checkable rationales catch partial fakes missed by one-step answers (99.6% vs. 78.4% on PartialEdit) and determine decisions under edits unseen in training (99.5%). Training updates only 29.7M of 2.85B parameters, fitting a single 24 GB GPU with gradient checkpointing. We release both models, inference code, a demo, and VeriSpoof-Bench, the evaluation suite covering these questions.

Community

Paper submitter

Hi everyone, author here šŸ‘‹

VeriSpoof is an open audio LLM for unified speech deepfake forensics. Beyond real or fake, the same weights also tell you where a recording was synthesized, which system made it, whether two recordings share a source, what the channel did to it, and why, in short lines you can check against the audio.

  • šŸ„‡ #1 open-weight on Speech-DF-Arena (2.14% EER over 14 test sets) and on SpoofRadar v1.0 (4.04%)
  • šŸ” The decision follows the evidence: edit the stated synthesized span and the decision flips
  • šŸŽÆ Catches 99.6% of partially edited recordings with reasoning (vs 78.4% answering in one step)
  • ⚔ 2.9B parameters, runs on a single 12 GB GPU; only 29.7M parameters are trained

šŸ¤— VeriSpoof-Plus Ā· VeriSpoof-Base Ā· Demo Ā· VeriSpoof-Bench

Happy to answer questions!

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.04634
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 3

Datasets citing this paper 1

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.