wsstriving commited on
Commit
ff7d15c
•
1 Parent(s): 73cc35e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +100 -0
README.md ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ pipeline_tag: summarization
6
+ tags:
7
+ - speaker embedding
8
+ - wespeaker
9
+ - speaker modelling
10
+ ---
11
+
12
+
13
+ Official model provided by [Wespeaker](https://github.com/wenet-e2e/wespeaker) project, ECAPA-TDNN based x-vector (After large margin finetune)
14
+
15
+ The model is trained on VoxCeleb2 Dev dataset, containing 5994 speakers.
16
+
17
+
18
+ ## Model Sources
19
+
20
+ <!-- Provide the basic links for the model. -->
21
+
22
+ - **Repository:** https://github.com/wenet-e2e/wespeaker
23
+ - **Paper:** https://arxiv.org/pdf/2210.17016.pdf
24
+ - **Demo:** https://huggingface.co/spaces/wenet/wespeaker_demo
25
+
26
+
27
+ ## Results on VoxCeleb
28
+ | Model | Params | Flops | LM | AS-Norm | vox1-O-clean | vox1-E-clean | vox1-H-clean |
29
+ |:------|:------:|:------|:--:|:-------:|:------------:|:------------:|:------------:|
30
+ | ECAPA_TDNN_GLOB_c512-ASTP-emb192 | 6.19M | 1.04G | × | × | 1.069 | 1.209 | 2.310 |
31
+ | | | | × | √ | 0.957 | 1.128 | 2.105 |
32
+ | | | | √ | × | 0.878 | 1.072 | 2.007 |
33
+ | | | | √ | √ | 0.782 | 1.005 | 1.824 |
34
+
35
+ ## Install Wespeaker
36
+
37
+ ``` sh
38
+ pip install git+https://github.com/wenet-e2e/wespeaker.git
39
+ ```
40
+
41
+ for development install:
42
+
43
+ ``` sh
44
+ git clone https://github.com/wenet-e2e/wespeaker.git
45
+ cd wespeaker
46
+ pip install -e .
47
+ ```
48
+
49
+
50
+ ### Command line Usage
51
+
52
+ ``` sh
53
+ $ wespeaker -p ecapa_tdnn512_download_dir --task embedding --audio_file audio.wav --output_file embedding.txt
54
+ $ wespeaker -p ecapa_tdnn512_download_dir --task embedding_kaldi --wav_scp wav.scp --output_file /path/to/embedding
55
+ $ wespeaker -p ecapa_tdnn512_download_dir --task similarity --audio_file audio.wav --audio_file2 audio2.wav
56
+ $ wespeaker -p ecapa_tdnn512_download_dir --task diarization --audio_file audio.wav
57
+ ```
58
+
59
+ ### Python Programming Usage
60
+
61
+ ``` python
62
+ import wespeaker
63
+
64
+ model = wespeaker.load_model_local(ecapa_tdnn512_download_dir)
65
+ # set_gpu to enable the cuda inference, number < 0 means using CPU
66
+ model.set_gpu(0)
67
+
68
+ # embedding/embedding_kaldi/similarity/diarization
69
+ embedding = model.extract_embedding('audio.wav')
70
+ utt_names, embeddings = model.extract_embedding_list('wav.scp')
71
+ similarity = model.compute_similarity('audio1.wav', 'audio2.wav')
72
+ diar_result = model.diarize('audio.wav')
73
+
74
+ # register and recognize
75
+ model.register('spk1', 'spk1_audio1.wav')
76
+ model.register('spk2', 'spk2_audio1.wav')
77
+ model.register('spk3', 'spk3_audio1.wav')
78
+ result = model.recognize('spk1_audio2.wav')
79
+ ```
80
+
81
+ ## Citation
82
+
83
+
84
+ ```bibtex
85
+ @article{desplanques2020ecapa,
86
+ title={Ecapa-tdnn: Emphasized channel attention, propagation and aggregation in tdnn based speaker verification},
87
+ author={Desplanques, Brecht and Thienpondt, Jenthe and Demuynck, Kris},
88
+ journal={arXiv preprint arXiv:2005.07143},
89
+ year={2020}
90
+ }
91
+
92
+ @inproceedings{wang2023wespeaker,
93
+ title={Wespeaker: A research and production oriented speaker embedding learning toolkit},
94
+ author={Wang, Hongji and Liang, Chengdong and Wang, Shuai and Chen, Zhengyang and Zhang, Binbin and Xiang, Xu and Deng, Yanlei and Qian, Yanmin},
95
+ booktitle={IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
96
+ pages={1--5},
97
+ year={2023},
98
+ organization={IEEE}
99
+ }
100
+ ```