XLSR-Conformer-TCM-DF: Speech Anti-Spoofing Arena wrapper

Packaged for the Speech Anti-Spoofing Arena from the authors' code and paper.

XLSR-Conformer + TCM (Truong et al., Interspeech 2024), DF-track model: a fully fine-tuned wav2vec 2.0 XLS-R 300M front-end projected to 144-d (Linear + BatchNorm + SELU), followed by 4 Conformer blocks whose multi-head self-attention carries the Temporal-Channel Modeling (TCM) module (per-head channel/head tokens, classification-token enrichment with the mean temporal and mean head tokens; 4 heads, depthwise conv kernel 31) and a class token feeding a linear 2-way head. Trained on ASVspoof2019 LA train with RawBoost (the paper's DF-track setting is stationary signal-independent additive noise). Checkpoint = the authors' released fixed-length DF model avg_5_best.pth (their own main.py average of the 5 best-validation checkpoints), unchanged. FP32, deterministic first-66800-sample window (shorter clips repeat-tiled).

  • Checkpoint (commit-pinned): model.safetensors
  • Params: 321.2132 M. Trained on ASVspoof 2019 LA train (RawBoost, DF-track setting).
  • Score: higher = bona fide. J-SPAW_LA was scored with the PyTorch wrapper; the other datasets with the TensorRT drop-in class (FP32 on the RTX 4070 Ti SUPER; FP32 on the RTX 5060 Ti), which matched PyTorch on the full J-SPAW_LA set.

Arena results

arena tier arena rank

EER% (lower is better); EmoSpoofTTS and LRLspoof are spoof-only and use 1-SRR% at the model's DeepVoice EER threshold. Per-dataset scores are under .eval_results/.

EER% 0.15 on ASVspoof2019_LA EER% 6.94 on ASVspoof2021_LA EER% 3.51 on ASVspoof2021_DF EER% 18.76 on ASVspoof5 EER% 7.85 on InTheWild EER% 20.02 on ADD22_eval_31 EER% 23.43 on ADD2023_track12_test_r1 EER% 15.09 on CFAD EER% 14.41 on CD-ADD EER% 11.01 on CVoiceFake_small EER% 29.14 on DeepVoice EER% 2.27 on LibriSeVoc EER% 26.4 on SONAR EER% 31.89 on ArAD EER% 11.89 on DECRO EER% 11.52 on J-SPAW_LA EER% 27.62 on ODSS EER% 2.19 on HABLA EER% 9.17 on DFADD EER% 8.29 on PyAra EER% 18.31 on XMAD EER% 1.61 on EmoFake_test SRR COMPLEMENT 65.86 on EmoSpoofTTS SRR COMPLEMENT 24.36 on LRLspoof

Citation

@inproceedings{truong24b_interspeech,
  title     = {{Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection}},
  author    = {Truong, Duc-Tuan and Tao, Ruijie and Nguyen, Tuan and Luong, Hieu-Thi and Lee, Kong Aik and Chng, Eng Siong},
  booktitle = {Interspeech 2024},
  pages     = {537--541},
  year      = {2024},
  doi       = {10.21437/Interspeech.2024-659}
}
Downloads last month
163
Safetensors
Model size
0.3B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support