Vocoded-VoxCeleb2-SSL-P2: Speech Anti-Spoofing Arena wrapper

Packaged for the Speech Anti-Spoofing Arena from the authors' code and paper.

NII vocoded-VoxCeleb2 SSL countermeasure, model ID P2 of Wang & Yamagishi (ICASSP 2024): two wav2vec 2.0 front ends whose last-layer outputs are subtracted (v.vox minus XLSR-53), where v.vox is XLSR-53 continually pre-trained (self-supervised, fairseq) on >9,000 h of VoxCeleb2 copy-synthesised by multiple neural vocoders. Back end: Linear 1024->128, three Linear+LeakyReLU+MC-dropout (p=0.5) blocks, mean pooling over frames and Linear 128->2. Whole model fine-tuned on voc.LA (vocoded ASVspoof 2019 LA train bona fide, ~10 h) with RawBoost. Score = logit of the mean bona-fide softmax over 144 Monte-Carlo-dropout samples (the authors' scoring), with fixed per-clip dropout masks. Authors' released seed-01 checkpoint (BSD-3). FP32, deterministic first-64600-sample window (shorter clips repeat-tiled) -- NOT the paper's full-utterance protocol.

  • Checkpoint (commit-pinned): model.safetensors
  • Params: 634.9622 M. Trained on vocoded ASVspoof 2019 LA train bona fide (voc.LA); SSL front end continually pre-trained on vocoded VoxCeleb2.
  • Score: higher = bona fide. J-SPAW_LA was scored with the PyTorch wrapper; the other datasets with the TensorRT drop-in class (FP32 on the RTX 4070 Ti SUPER; FP32 on the RTX 5060 Ti), which matched PyTorch on the full J-SPAW_LA set.

Arena results

arena tier arena rank

EER% (lower is better); EmoSpoofTTS and LRLspoof are spoof-only and use 1-SRR% at the model's DeepVoice EER threshold. Per-dataset scores are under .eval_results/.

EER% 2.24 on ASVspoof2019_LA EER% 15.93 on ASVspoof2021_LA EER% 7.25 on ASVspoof2021_DF EER% 22.96 on ASVspoof5 EER% 4.34 on InTheWild EER% 11.52 on ADD22_eval_31 EER% 27.98 on ADD2023_track12_test_r1 EER% 10.73 on CFAD EER% 5.33 on CD-ADD EER% 19.01 on CVoiceFake_small EER% 15.86 on DeepVoice EER% 0.91 on LibriSeVoc EER% 10.2 on SONAR EER% 36.78 on ArAD EER% 18.55 on DECRO EER% 7.45 on J-SPAW_LA EER% 25.8 on ODSS EER% 4.32 on HABLA EER% 3.73 on DFADD EER% 14.59 on PyAra EER% 31.77 on XMAD EER% 0.11 on EmoFake_test SRR COMPLEMENT 41.29 on EmoSpoofTTS SRR COMPLEMENT 24.16 on LRLspoof

Citation

@inproceedings{wang2024vocoded,
  title     = {Can Large-Scale Vocoded Spoofed Data Improve Speech Spoofing Countermeasure with a Self-Supervised Front End?},
  author    = {Wang, Xin and Yamagishi, Junichi},
  booktitle = {ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  year      = {2024},
  eprint    = {2309.06014},
  archivePrefix = {arXiv}
}
Downloads last month
10
Safetensors
Model size
0.6B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Paper for SpeechAntiSpoofingBenchmarks/Vocoded-VoxCeleb2-SSL-P2