Vocoded-VoxCeleb2-SSL-P3: Speech Anti-Spoofing Arena wrapper

Packaged for the Speech Anti-Spoofing Arena from the authors' code and paper.

NII vocoded-VoxCeleb2 SSL countermeasure, model ID P3 of Wang & Yamagishi (ICASSP 2024): a single wav2vec 2.0 student front end initialised from XLSR-53 and distilled from the feature difference of two teacher SSLs (v.vox minus XLSR-53), where v.vox is XLSR-53 continually pre-trained (self-supervised, fairseq) on >9,000 h of VoxCeleb2 copy-synthesised by multiple neural vocoders; the paper's proposed single-SSL model. Back end: Linear 1024->128, three Linear+LeakyReLU+MC-dropout (p=0.5) blocks, mean pooling over frames and Linear 128->2. Whole model fine-tuned on voc.LA (vocoded ASVspoof 2019 LA train bona fide, ~10 h) with RawBoost. Score = logit of the mean bona-fide softmax over 144 Monte-Carlo-dropout samples (the authors' scoring), with fixed per-clip dropout masks. Authors' released seed-01 checkpoint (BSD-3). FP32, deterministic first-64600-sample window (shorter clips repeat-tiled) -- NOT the paper's full-utterance protocol.

  • Checkpoint (commit-pinned): model.safetensors
  • Params: 317.5716 M. Trained on vocoded ASVspoof 2019 LA train bona fide (voc.LA); SSL front end continually pre-trained on vocoded VoxCeleb2.
  • Score: higher = bona fide. J-SPAW_LA was scored with the PyTorch wrapper; the other datasets with the TensorRT drop-in class (FP32 on the RTX 4070 Ti SUPER; FP32 on the RTX 5060 Ti), which matched PyTorch on the full J-SPAW_LA set.

Arena results

arena tier arena rank

EER% (lower is better); EmoSpoofTTS and LRLspoof are spoof-only and use 1-SRR% at the model's DeepVoice EER threshold. Per-dataset scores are under .eval_results/.

EER% 2.66 on ASVspoof2019_LA EER% 16.37 on ASVspoof2021_LA EER% 6.41 on ASVspoof2021_DF EER% 22.11 on ASVspoof5 EER% 5.39 on InTheWild EER% 13.57 on ADD22_eval_31 EER% 28.37 on ADD2023_track12_test_r1 EER% 10.62 on CFAD EER% 5.82 on CD-ADD EER% 15.41 on CVoiceFake_small EER% 28.03 on DeepVoice EER% 0.92 on LibriSeVoc EER% 9.56 on SONAR EER% 34.3 on ArAD EER% 18.35 on DECRO EER% 9.62 on J-SPAW_LA EER% 23.19 on ODSS EER% 5.4 on HABLA EER% 5.96 on DFADD EER% 14.26 on PyAra EER% 25.69 on XMAD EER% 0.09 on EmoFake_test SRR COMPLEMENT 57.06 on EmoSpoofTTS SRR COMPLEMENT 31.79 on LRLspoof

Citation

@inproceedings{wang2024vocoded,
  title     = {Can Large-Scale Vocoded Spoofed Data Improve Speech Spoofing Countermeasure with a Self-Supervised Front End?},
  author    = {Wang, Xin and Yamagishi, Junichi},
  booktitle = {ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  year      = {2024},
  eprint    = {2309.06014},
  archivePrefix = {arXiv}
}
Downloads last month
5
Safetensors
Model size
0.3B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Paper for SpeechAntiSpoofingBenchmarks/Vocoded-VoxCeleb2-SSL-P3