johnislarry philschmid HF staff commited on
Commit
332fbc8
0 Parent(s):

Duplicate from philschmid/pyannote-speaker-diarization-endpoint

Browse files

Co-authored-by: Philipp Schmid <philschmid@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ftz filter=lfs diff=lfs merge=lfs -text
6
+ *.gz filter=lfs diff=lfs merge=lfs -text
7
+ *.h5 filter=lfs diff=lfs merge=lfs -text
8
+ *.joblib filter=lfs diff=lfs merge=lfs -text
9
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
10
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
11
+ *.model filter=lfs diff=lfs merge=lfs -text
12
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
13
+ *.npy filter=lfs diff=lfs merge=lfs -text
14
+ *.npz filter=lfs diff=lfs merge=lfs -text
15
+ *.onnx filter=lfs diff=lfs merge=lfs -text
16
+ *.ot filter=lfs diff=lfs merge=lfs -text
17
+ *.parquet filter=lfs diff=lfs merge=lfs -text
18
+ *.pb filter=lfs diff=lfs merge=lfs -text
19
+ *.pickle filter=lfs diff=lfs merge=lfs -text
20
+ *.pkl filter=lfs diff=lfs merge=lfs -text
21
+ *.pt filter=lfs diff=lfs merge=lfs -text
22
+ *.pth filter=lfs diff=lfs merge=lfs -text
23
+ *.rar filter=lfs diff=lfs merge=lfs -text
24
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
25
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
26
+ *.tflite filter=lfs diff=lfs merge=lfs -text
27
+ *.tgz filter=lfs diff=lfs merge=lfs -text
28
+ *.wasm filter=lfs diff=lfs merge=lfs -text
29
+ *.xz filter=lfs diff=lfs merge=lfs -text
30
+ *.zip filter=lfs diff=lfs merge=lfs -text
31
+ *.zst filter=lfs diff=lfs merge=lfs -text
32
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
33
+ 8415189576557ef37bfc0faffcf8675775aed3416881ba556212c05e.wav filter=lfs diff=lfs merge=lfs -text
8415189576557ef37bfc0faffcf8675775aed3416881ba556212c05e.wav ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:519c20010cb3b2fad0cc119765d8f26c537070fe532f59a9acb7b13b6b38541f
3
+ size 2654526
README.md ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - pyannote
4
+ - pyannote-audio
5
+ - pyannote-audio-pipeline
6
+ - audio
7
+ - voice
8
+ - speech
9
+ - speaker
10
+ - speaker-diarization
11
+ - speaker-change-detection
12
+ - voice-activity-detection
13
+ - overlapped-speech-detection
14
+ datasets:
15
+ - ami
16
+ - dihard
17
+ - voxconverse
18
+ - aishell
19
+ - repere
20
+ - voxceleb
21
+ license: mit
22
+ duplicated_from: philschmid/pyannote-speaker-diarization-endpoint
23
+ ---
24
+
25
+ # 🎹 Speaker diarization
26
+
27
+ Relies on pyannote.audio 2.0: see [installation instructions](https://github.com/pyannote/pyannote-audio/tree/develop#installation).
28
+
29
+
30
+ ## TL;DR
31
+
32
+ ```python
33
+ # load the pipeline from Hugginface Hub
34
+ from pyannote.audio import Pipeline
35
+ pipeline = Pipeline.from_pretrained("pyannote/speaker-diarization@2022.07")
36
+
37
+ # apply the pipeline to an audio file
38
+ diarization = pipeline("audio.wav")
39
+
40
+ # dump the diarization output to disk using RTTM format
41
+ with open("audio.rttm", "w") as rttm:
42
+ diarization.write_rttm(rttm)
43
+ ```
44
+
45
+ ## Advanced usage
46
+
47
+ In case the number of speakers is known in advance, one can use the `num_speakers` option:
48
+
49
+ ```python
50
+ diarization = pipeline("audio.wav", num_speakers=2)
51
+ ```
52
+
53
+ One can also provide lower and/or upper bounds on the number of speakers using `min_speakers` and `max_speakers` options:
54
+
55
+ ```python
56
+ diarization = pipeline("audio.wav", min_speakers=2, max_speakers=5)
57
+ ```
58
+
59
+ If you feel adventurous, you can try and play with the various pipeline hyper-parameters.
60
+ For instance, one can use a more aggressive voice activity detection by increasing the value of `segmentation_onset` threshold:
61
+
62
+ ```python
63
+ hparams = pipeline.parameters(instantiated=True)
64
+ hparams["segmentation_onset"] += 0.1
65
+ pipeline.instantiate(hparams)
66
+ ```
67
+
68
+ ## Benchmark
69
+
70
+ ### Real-time factor
71
+
72
+ Real-time factor is around 5% using one Nvidia Tesla V100 SXM2 GPU (for the neural inference part) and one Intel Cascade Lake 6248 CPU (for the clustering part).
73
+
74
+ In other words, it takes approximately 3 minutes to process a one hour conversation.
75
+
76
+ ### Accuracy
77
+
78
+ This pipeline is benchmarked on a growing collection of datasets.
79
+
80
+ Processing is fully automatic:
81
+
82
+ * no manual voice activity detection (as is sometimes the case in the literature)
83
+ * no manual number of speakers (though it is possible to provide it to the pipeline)
84
+ * no fine-tuning of the internal models nor tuning of the pipeline hyper-parameters to each dataset
85
+
86
+ ... with the least forgiving diarization error rate (DER) setup (named *"Full"* in [this paper](https://doi.org/10.1016/j.csl.2021.101254)):
87
+
88
+ * no forgiveness collar
89
+ * evaluation of overlapped speech
90
+
91
+
92
+ | Benchmark | [DER%](. "Diarization error rate") | [FA%](. "False alarm rate") | [Miss%](. "Missed detection rate") | [Conf%](. "Speaker confusion rate") | Expected output | File-level evaluation |
93
+ | ---------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------- | --------------------------- | ---------------------------------- | ----------------------------------- | ------------------------------------------------------------------------------------------ | ------------------------------------------------------------------------------------------ |
94
+ | [AISHELL-4](http://www.openslr.org/111/) | 14.61 | 3.31 | 4.35 | 6.95 | [RTTM](reproducible_research/AISHELL.SpeakerDiarization.Full.test.rttm) | [eval](reproducible_research/AISHELL.SpeakerDiarization.Full.test.eval) |
95
+ | [AMI *Mix-Headset*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 18.21 | 3.28 | 11.07 | 3.87 | [RTTM](reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.rttm) | [eval](reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.eval) |
96
+ | [AMI *Array1-01*](https://groups.inf.ed.ac.uk/ami/corpus/) [*only_words*](https://github.com/BUTSpeechFIT/AMI-diarization-setup) | 29.00 | 2.71 | 21.61 | 4.68 | [RTTM](reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.rttm) | [eval](reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.eval) |
97
+ | [CALLHOME](https://catalog.ldc.upenn.edu/LDC2001S97) [*Part2*](https://github.com/BUTSpeechFIT/CALLHOME_sublists/issues/1) | 30.24 | 3.71 | 16.86 | 9.66 | [RTTM](reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.rttm) | [eval](reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.eval) |
98
+ | [DIHARD 3 *Full*](https://arxiv.org/abs/2012.01477) | 20.99 | 4.25 | 10.74 | 6.00 | [RTTM](reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.rttm) | [eval](reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.eval) |
99
+ | [REPERE *Phase 2*](https://islrn.org/resources/360-758-359-485-0/) | 12.62 | 1.55 | 3.30 | 7.76 | [RTTM](reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.rttm) | [eval](reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.eval) |
100
+ | [VoxConverse *v0.0.2*](https://github.com/joonson/voxconverse) | 12.76 | 3.45 | 3.85 | 5.46 | [RTTM](reproducible_research/2022.07/VoxConverse.SpeakerDiarization.VoxConverse.test.rttm) | [eval](reproducible_research/2022.07/VoxConverse.SpeakerDiarization.VoxConverse.test.eval) |
101
+
102
+
103
+ ## Support
104
+
105
+ For commercial enquiries and scientific consulting, please contact [me](mailto:herve@niderb.fr).
106
+ For [technical questions](https://github.com/pyannote/pyannote-audio/discussions) and [bug reports](https://github.com/pyannote/pyannote-audio/issues), please check [pyannote.audio](https://github.com/pyannote/pyannote-audio) Github repository.
107
+
108
+
109
+ ## Citations
110
+
111
+ ```bibtex
112
+ @inproceedings{Bredin2021,
113
+ Title = {{End-to-end speaker segmentation for overlap-aware resegmentation}},
114
+ Author = {{Bredin}, Herv{\'e} and {Laurent}, Antoine},
115
+ Booktitle = {Proc. Interspeech 2021},
116
+ Address = {Brno, Czech Republic},
117
+ Month = {August},
118
+ Year = {2021},
119
+ }
120
+ ```
121
+
122
+ ```bibtex
123
+ @inproceedings{Bredin2020,
124
+ Title = {{pyannote.audio: neural building blocks for speaker diarization}},
125
+ Author = {{Bredin}, Herv{\'e} and {Yin}, Ruiqing and {Coria}, Juan Manuel and {Gelly}, Gregory and {Korshunov}, Pavel and {Lavechin}, Marvin and {Fustes}, Diego and {Titeux}, Hadrien and {Bouaziz}, Wassim and {Gill}, Marie-Philippe},
126
+ Booktitle = {ICASSP 2020, IEEE International Conference on Acoustics, Speech, and Signal Processing},
127
+ Address = {Barcelona, Spain},
128
+ Month = {May},
129
+ Year = {2020},
130
+ }
131
+ ```
config.yaml ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ pipeline:
2
+ name: pyannote.audio.pipelines.SpeakerDiarization
3
+ params:
4
+ segmentation: philschmid/pyannote-segmentation
5
+ segmentation_step: 0.1
6
+ segmentation_batch_size: 32
7
+ # embedding: speechbrain/spkrec-ecapa-voxceleb@5c0be3875fda05e81f3c004ed8c7c06be308de1e
8
+ embedding: speechbrain/spkrec-ecapa-voxceleb
9
+ embedding_exclude_overlap: True
10
+ embedding_batch_size: 32
11
+ clustering: HiddenMarkovModelClustering
12
+
13
+ params:
14
+ segmentation_onset: 0.58
15
+ clustering:
16
+ covariance_type: diag
17
+ threshold: 0.35
18
+ single_cluster_detection:
19
+ quantile: 0.05
20
+ threshold: 1.15
create_handler.ipynb ADDED
@@ -0,0 +1,229 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cells": [
3
+ {
4
+ "cell_type": "markdown",
5
+ "metadata": {},
6
+ "source": [
7
+ "## 1. Setup & Installation"
8
+ ]
9
+ },
10
+ {
11
+ "cell_type": "code",
12
+ "execution_count": 1,
13
+ "metadata": {},
14
+ "outputs": [
15
+ {
16
+ "name": "stdout",
17
+ "output_type": "stream",
18
+ "text": [
19
+ "Overwriting requirements.txt\n"
20
+ ]
21
+ }
22
+ ],
23
+ "source": [
24
+ "%%writefile requirements.txt\n",
25
+ "torchaudio==0.11.*\n",
26
+ "git+https://github.com/philschmid/pyannote-audio.git"
27
+ ]
28
+ },
29
+ {
30
+ "cell_type": "code",
31
+ "execution_count": null,
32
+ "metadata": {},
33
+ "outputs": [],
34
+ "source": [
35
+ "!pip install -r requirements.txt --upgrade"
36
+ ]
37
+ },
38
+ {
39
+ "cell_type": "markdown",
40
+ "metadata": {},
41
+ "source": [
42
+ "## 2. Create Custom Handler for Inference Endpoints\n"
43
+ ]
44
+ },
45
+ {
46
+ "cell_type": "code",
47
+ "execution_count": 2,
48
+ "metadata": {},
49
+ "outputs": [
50
+ {
51
+ "name": "stdout",
52
+ "output_type": "stream",
53
+ "text": [
54
+ "Overwriting handler.py\n"
55
+ ]
56
+ }
57
+ ],
58
+ "source": [
59
+ "%%writefile handler.py\n",
60
+ "from typing import Dict\n",
61
+ "from pyannote.audio import Pipeline\n",
62
+ "from transformers.pipelines.audio_utils import ffmpeg_read\n",
63
+ "import torch \n",
64
+ "\n",
65
+ "SAMPLE_RATE = 16000\n",
66
+ "\n",
67
+ "\n",
68
+ "\n",
69
+ "class EndpointHandler():\n",
70
+ " def __init__(self, path=\"\"):\n",
71
+ " # load the model\n",
72
+ " self.pipeline = Pipeline.from_pretrained(\"pyannote/speaker-diarization\")\n",
73
+ "\n",
74
+ "\n",
75
+ " def __call__(self, data: Dict[str, bytes]) -> Dict[str, str]:\n",
76
+ " \"\"\"\n",
77
+ " Args:\n",
78
+ " data (:obj:):\n",
79
+ " includes the deserialized audio file as bytes\n",
80
+ " Return:\n",
81
+ " A :obj:`dict`:. base64 encoded image\n",
82
+ " \"\"\"\n",
83
+ " # process input\n",
84
+ " inputs = data.pop(\"inputs\", data)\n",
85
+ " parameters = data.pop(\"parameters\", None) # min_speakers=2, max_speakers=5\n",
86
+ "\n",
87
+ " \n",
88
+ " # prepare pynannote input\n",
89
+ " audio_nparray = ffmpeg_read(inputs, SAMPLE_RATE)\n",
90
+ " audio_tensor= torch.from_numpy(audio_nparray).unsqueeze(0)\n",
91
+ " pyannote_input = {\"waveform\": audio_tensor, \"sample_rate\": SAMPLE_RATE}\n",
92
+ " \n",
93
+ " # apply pretrained pipeline\n",
94
+ " # pass inputs with all kwargs in data\n",
95
+ " if parameters is not None:\n",
96
+ " diarization = self.pipeline(pyannote_input, **parameters)\n",
97
+ " else:\n",
98
+ " diarization = self.pipeline(pyannote_input)\n",
99
+ "\n",
100
+ " # postprocess the prediction\n",
101
+ " processed_diarization = [\n",
102
+ " {\"label\": str(label), \"start\": str(segment.start), \"stop\": str(segment.end)}\n",
103
+ " for segment, _, label in diarization.itertracks(yield_label=True)\n",
104
+ " ]\n",
105
+ " \n",
106
+ " return {\"diarization\": processed_diarization}"
107
+ ]
108
+ },
109
+ {
110
+ "cell_type": "markdown",
111
+ "metadata": {},
112
+ "source": [
113
+ "test custom pipeline"
114
+ ]
115
+ },
116
+ {
117
+ "cell_type": "code",
118
+ "execution_count": 1,
119
+ "metadata": {},
120
+ "outputs": [],
121
+ "source": [
122
+ "from handler import EndpointHandler\n",
123
+ "\n",
124
+ "# init handler\n",
125
+ "my_handler = EndpointHandler(path=\".\")"
126
+ ]
127
+ },
128
+ {
129
+ "cell_type": "code",
130
+ "execution_count": 2,
131
+ "metadata": {},
132
+ "outputs": [],
133
+ "source": [
134
+ "import base64\n",
135
+ "from PIL import Image\n",
136
+ "from io import BytesIO\n",
137
+ "import json\n",
138
+ "\n",
139
+ "# file reader\n",
140
+ "with open(\"sample.wav\", \"rb\") as f:\n",
141
+ " request = {\"inputs\": f.read()}\n",
142
+ "\n",
143
+ "# test the handler\n",
144
+ "pred = my_handler(request)"
145
+ ]
146
+ },
147
+ {
148
+ "cell_type": "code",
149
+ "execution_count": 3,
150
+ "metadata": {},
151
+ "outputs": [
152
+ {
153
+ "data": {
154
+ "text/plain": [
155
+ "{'diarization': [{'label': 'SPEAKER_01',\n",
156
+ " 'start': '0.4978125',\n",
157
+ " 'stop': '1.3921875'},\n",
158
+ " {'label': 'SPEAKER_01', 'start': '1.8984375', 'stop': '2.7590624999999998'},\n",
159
+ " {'label': 'SPEAKER_02', 'start': '2.9953125', 'stop': '3.5015625000000004'},\n",
160
+ " {'label': 'SPEAKER_01',\n",
161
+ " 'start': '3.5690625000000002',\n",
162
+ " 'stop': '4.311562500000001'},\n",
163
+ " {'label': 'SPEAKER_02', 'start': '4.6153125', 'stop': '6.7753125'},\n",
164
+ " {'label': 'SPEAKER_00', 'start': '7.1128125', 'stop': '7.551562500000001'},\n",
165
+ " {'label': 'SPEAKER_02',\n",
166
+ " 'start': '7.551562500000001',\n",
167
+ " 'stop': '9.475312500000001'},\n",
168
+ " {'label': 'SPEAKER_02',\n",
169
+ " 'start': '9.812812500000003',\n",
170
+ " 'stop': '10.555312500000003'},\n",
171
+ " {'label': 'SPEAKER_00',\n",
172
+ " 'start': '9.863437500000003',\n",
173
+ " 'stop': '10.420312500000001'},\n",
174
+ " {'label': 'SPEAKER_03', 'start': '12.411562500000002', 'stop': '15.5503125'},\n",
175
+ " {'label': 'SPEAKER_00', 'start': '15.786562500000002', 'stop': '16.1409375'},\n",
176
+ " {'label': 'SPEAKER_01', 'start': '16.1409375', 'stop': '16.1578125'},\n",
177
+ " {'label': 'SPEAKER_00', 'start': '17.1534375', 'stop': '17.4234375'},\n",
178
+ " {'label': 'SPEAKER_01', 'start': '17.7440625', 'stop': '20.3596875'},\n",
179
+ " {'label': 'SPEAKER_01', 'start': '20.6128125', 'stop': '20.6634375'},\n",
180
+ " {'label': 'SPEAKER_00', 'start': '20.6634375', 'stop': '20.8490625'},\n",
181
+ " {'label': 'SPEAKER_01', 'start': '20.8490625', 'stop': '20.8828125'},\n",
182
+ " {'label': 'SPEAKER_01', 'start': '21.1021875', 'stop': '22.1315625'},\n",
183
+ " {'label': 'SPEAKER_02', 'start': '22.4521875', 'stop': '22.7053125'},\n",
184
+ " {'label': 'SPEAKER_02', 'start': '23.2115625', 'stop': '23.4815625'},\n",
185
+ " {'label': 'SPEAKER_01', 'start': '23.4815625', 'stop': '24.0215625'},\n",
186
+ " {'label': 'SPEAKER_02', 'start': '24.3253125', 'stop': '25.5065625'},\n",
187
+ " {'label': 'SPEAKER_01', 'start': '25.8440625', 'stop': '27.3121875'},\n",
188
+ " {'label': 'SPEAKER_02', 'start': '27.3121875', 'stop': '27.4978125'},\n",
189
+ " {'label': 'SPEAKER_01', 'start': '29.7253125', 'stop': '29.9615625'}]}"
190
+ ]
191
+ },
192
+ "execution_count": 3,
193
+ "metadata": {},
194
+ "output_type": "execute_result"
195
+ }
196
+ ],
197
+ "source": [
198
+ "pred"
199
+ ]
200
+ }
201
+ ],
202
+ "metadata": {
203
+ "kernelspec": {
204
+ "display_name": "Python 3.9.13 ('dev': conda)",
205
+ "language": "python",
206
+ "name": "python3"
207
+ },
208
+ "language_info": {
209
+ "codemirror_mode": {
210
+ "name": "ipython",
211
+ "version": 3
212
+ },
213
+ "file_extension": ".py",
214
+ "mimetype": "text/x-python",
215
+ "name": "python",
216
+ "nbconvert_exporter": "python",
217
+ "pygments_lexer": "ipython3",
218
+ "version": "3.9.13"
219
+ },
220
+ "orig_nbformat": 4,
221
+ "vscode": {
222
+ "interpreter": {
223
+ "hash": "f6dd96c16031089903d5a31ec148b80aeb0d39c32affb1a1080393235fbfa2fc"
224
+ }
225
+ }
226
+ },
227
+ "nbformat": 4,
228
+ "nbformat_minor": 2
229
+ }
handler.py ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from typing import Dict
2
+ from pyannote.audio import Pipeline
3
+ from transformers.pipelines.audio_utils import ffmpeg_read
4
+ import torch
5
+
6
+ SAMPLE_RATE = 16000
7
+
8
+
9
+
10
+ class EndpointHandler():
11
+ def __init__(self, path=""):
12
+ # load the model
13
+ self.pipeline = Pipeline.from_pretrained("philschmid/pyannote-speaker-diarization-endpoint")
14
+
15
+
16
+ def __call__(self, data: Dict[str, bytes]) -> Dict[str, str]:
17
+ """
18
+ Args:
19
+ data (:obj:):
20
+ includes the deserialized audio file as bytes
21
+ Return:
22
+ A :obj:`dict`:. base64 encoded image
23
+ """
24
+ # process input
25
+ inputs = data.pop("inputs", data)
26
+ parameters = data.pop("parameters", None) # min_speakers=2, max_speakers=5
27
+
28
+
29
+ # prepare pynannote input
30
+ audio_nparray = ffmpeg_read(inputs, SAMPLE_RATE)
31
+ audio_tensor= torch.from_numpy(audio_nparray).unsqueeze(0)
32
+ pyannote_input = {"waveform": audio_tensor, "sample_rate": SAMPLE_RATE}
33
+
34
+ # apply pretrained pipeline
35
+ # pass inputs with all kwargs in data
36
+ if parameters is not None:
37
+ diarization = self.pipeline(pyannote_input, **parameters)
38
+ else:
39
+ diarization = self.pipeline(pyannote_input)
40
+
41
+ # postprocess the prediction
42
+ processed_diarization = [
43
+ {"label": str(label), "start": str(segment.start), "stop": str(segment.end)}
44
+ for segment, _, label in diarization.itertracks(yield_label=True)
45
+ ]
46
+
47
+ return {"diarization": processed_diarization}
reproducible_research/2022.07/AISHELL.SpeakerDiarization.Full.test.eval ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ L_R003S01C02 18.89 2311.97 1980.25 85.65 104.95 4.54 144.55 6.25 187.17 8.10
5
+ L_R003S02C02 12.74 2036.79 1832.36 89.96 55.15 2.71 93.48 4.59 110.94 5.45
6
+ L_R003S03C02 16.46 2376.45 2045.30 86.07 59.97 2.52 206.09 8.67 125.06 5.26
7
+ L_R003S04C02 17.63 2011.85 1752.94 87.13 95.70 4.76 78.03 3.88 180.89 8.99
8
+ L_R004S01C01 10.96 2041.84 1877.74 91.96 59.67 2.92 53.53 2.62 110.58 5.42
9
+ L_R004S02C01 14.78 2204.89 1970.28 89.36 91.27 4.14 57.61 2.61 177.01 8.03
10
+ L_R004S03C01 12.31 2314.18 2103.86 90.91 74.52 3.22 86.45 3.74 123.87 5.35
11
+ L_R004S06C01 9.26 2029.95 1861.81 91.72 19.85 0.98 44.98 2.22 123.15 6.07
12
+ M_R003S01C01 15.04 2191.47 1935.43 88.32 73.45 3.35 126.17 5.76 129.87 5.93
13
+ M_R003S02C01 15.14 2376.79 2052.14 86.34 35.24 1.48 204.97 8.62 119.69 5.04
14
+ M_R003S04C01 37.43 2015.63 1444.81 71.68 183.54 9.11 93.33 4.63 477.50 23.69
15
+ M_R003S05C01 46.60 2249.68 1344.71 59.77 143.29 6.37 134.14 5.96 770.84 34.26
16
+ S_R003S01C01 11.02 2127.86 1984.73 93.27 91.34 4.29 69.86 3.28 73.27 3.44
17
+ S_R003S02C01 8.70 2222.87 2097.15 94.34 67.66 3.04 71.94 3.24 53.78 2.42
18
+ S_R003S03C01 10.01 2071.12 1957.05 94.49 93.19 4.50 71.56 3.45 42.51 2.05
19
+ S_R003S04C01 16.47 2615.78 2254.19 86.18 69.33 2.65 218.44 8.35 143.15 5.47
20
+ S_R004S01C01 4.65 2117.91 2043.76 96.50 24.30 1.15 64.34 3.04 9.81 0.46
21
+ S_R004S02C01 5.04 2095.08 2027.67 96.78 38.13 1.82 35.96 1.72 31.45 1.50
22
+ S_R004S03C01 2.13 2074.39 2046.66 98.66 16.48 0.79 26.72 1.29 1.01 0.05
23
+ S_R004S04C01 4.43 2078.85 2029.99 97.65 43.19 2.08 12.66 0.61 36.20 1.74
24
+ TOTAL 14.61 43565.36 38642.83 88.70 1440.22 3.31 1894.78 4.35 3027.75 6.95
reproducible_research/2022.07/AISHELL.SpeakerDiarization.Full.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.eval ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ IS1009a 24.82 695.90 551.42 79.24 28.26 4.06 105.19 15.12 39.30 5.65
5
+ IS1009b 18.19 1982.97 1665.33 83.98 43.16 2.18 188.29 9.50 129.35 6.52
6
+ IS1009c 10.73 1584.45 1454.66 91.81 40.28 2.54 101.36 6.40 28.43 1.79
7
+ IS1009d 21.76 1738.60 1411.01 81.16 50.71 2.92 240.37 13.83 87.21 5.02
8
+ ES2004a 30.72 923.43 665.42 72.06 25.66 2.78 224.83 24.35 33.17 3.59
9
+ ES2004b 21.04 2233.05 1829.67 81.94 66.39 2.97 322.27 14.43 81.11 3.63
10
+ ES2004c 19.10 2244.47 1879.88 83.76 64.10 2.86 313.00 13.95 51.59 2.30
11
+ ES2004d 40.00 2006.77 1263.38 62.96 59.23 2.95 628.10 31.30 115.30 5.75
12
+ TS3003a 51.75 1025.96 511.92 49.90 16.84 1.64 434.09 42.31 79.95 7.79
13
+ TS3003b 24.29 1820.50 1420.39 78.02 42.14 2.31 356.26 19.57 43.86 2.41
14
+ TS3003c 27.48 1894.25 1402.48 74.04 28.73 1.52 456.43 24.10 35.35 1.87
15
+ TS3003d 40.66 2070.34 1272.24 61.45 43.63 2.11 698.61 33.74 99.49 4.81
16
+ EN2002a 38.25 2530.26 1627.41 64.32 64.94 2.57 650.93 25.73 251.92 9.96
17
+ EN2002b 34.17 1943.44 1352.31 69.58 72.91 3.75 434.54 22.36 156.59 8.06
18
+ EN2002c 27.01 3343.64 2543.30 76.06 102.86 3.08 723.62 21.64 76.72 2.29
19
+ EN2002d 36.26 2675.89 1786.53 66.76 81.01 3.03 759.94 28.40 129.42 4.84
20
+ TOTAL 29.00 30713.92 22637.34 73.70 830.87 2.71 6637.83 21.61 1438.76 4.68
reproducible_research/2022.07/AMI-SDM.SpeakerDiarization.only_words.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.eval ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ IS1009a 19.44 695.90 592.48 85.14 31.84 4.58 70.29 10.10 33.13 4.76
5
+ IS1009b 15.24 1982.97 1723.50 86.92 42.83 2.16 153.10 7.72 106.37 5.36
6
+ IS1009c 9.14 1584.45 1496.41 94.44 56.80 3.58 61.50 3.88 26.54 1.68
7
+ IS1009d 16.46 1738.60 1511.70 86.95 59.21 3.41 159.94 9.20 66.96 3.85
8
+ ES2004a 18.46 923.43 772.39 83.64 19.44 2.11 129.71 14.05 21.33 2.31
9
+ ES2004b 14.49 2233.05 1979.20 88.63 69.69 3.12 164.01 7.34 89.84 4.02
10
+ ES2004c 12.53 2244.47 2062.64 91.90 99.41 4.43 135.93 6.06 45.91 2.05
11
+ ES2004d 19.69 2006.77 1722.17 85.82 110.55 5.51 200.45 9.99 84.14 4.19
12
+ TS3003a 21.19 1025.96 832.85 81.18 24.28 2.37 137.37 13.39 55.74 5.43
13
+ TS3003b 11.39 1820.50 1699.32 93.34 86.19 4.73 98.56 5.41 22.61 1.24
14
+ TS3003c 14.11 1894.25 1702.53 89.88 75.55 3.99 165.12 8.72 26.61 1.40
15
+ TS3003d 21.92 2070.34 1699.60 82.09 83.14 4.02 309.75 14.96 60.98 2.95
16
+ EN2002a 23.15 2530.26 2016.12 79.68 71.72 2.83 386.82 15.29 127.33 5.03
17
+ EN2002b 26.12 1943.44 1493.22 76.83 57.42 2.95 263.63 13.57 186.59 9.60
18
+ EN2002c 17.98 3343.64 2787.46 83.37 44.93 1.34 472.74 14.14 83.44 2.50
19
+ EN2002d 26.66 2675.89 2035.89 76.08 73.29 2.74 489.92 18.31 150.08 5.61
20
+ TOTAL 18.21 30713.92 26127.49 85.07 1006.29 3.28 3398.83 11.07 1187.60 3.87
reproducible_research/2022.07/AMI.SpeakerDiarization.only_words.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.eval ADDED
@@ -0,0 +1,254 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ iaab 28.85 43.87 36.16 82.42 4.94 11.27 5.01 11.41 2.71 6.17
5
+ iaad 19.24 335.25 275.98 82.32 5.23 1.56 53.93 16.09 5.34 1.59
6
+ iaae 32.55 105.89 72.02 68.01 0.60 0.57 28.31 26.73 5.56 5.25
7
+ iaaf 28.56 70.37 52.40 74.46 2.12 3.01 13.82 19.63 4.16 5.91
8
+ iaag 32.76 117.45 90.20 76.80 11.22 9.55 19.15 16.31 8.10 6.90
9
+ iaai 23.25 82.64 64.25 77.75 0.82 0.99 15.39 18.62 3.00 3.63
10
+ iaaj 33.03 244.04 167.30 68.55 3.87 1.59 65.12 26.68 11.62 4.76
11
+ iaam 23.46 61.21 48.44 79.13 1.58 2.59 5.32 8.69 7.46 12.18
12
+ iaap 31.69 104.70 74.90 71.53 3.37 3.22 19.83 18.94 9.97 9.52
13
+ iaaq 40.94 61.28 36.56 59.66 0.37 0.60 10.16 16.58 14.56 23.75
14
+ iaar 40.56 115.40 88.29 76.51 19.70 17.07 14.99 12.99 12.12 10.50
15
+ iaas 26.17 209.43 155.97 74.47 1.34 0.64 38.96 18.60 14.50 6.92
16
+ iaaw 16.89 72.48 61.43 84.75 1.19 1.64 10.83 14.94 0.22 0.31
17
+ iaay 32.28 61.04 44.88 73.52 3.54 5.80 13.04 21.37 3.12 5.11
18
+ iaaz 32.86 107.98 74.16 68.67 1.65 1.53 33.58 31.10 0.24 0.23
19
+ iaba 40.15 455.81 284.79 62.48 11.97 2.63 121.06 26.56 49.96 10.96
20
+ iabe 35.20 90.45 63.38 70.07 4.77 5.28 15.73 17.39 11.34 12.54
21
+ iabg 14.93 83.78 73.26 87.45 1.99 2.38 8.87 10.59 1.64 1.96
22
+ iabj 10.33 119.05 108.39 91.04 1.63 1.37 10.49 8.81 0.17 0.15
23
+ iabo 56.50 59.73 29.65 49.64 3.67 6.14 9.43 15.79 20.65 34.57
24
+ iabp 21.48 57.68 45.87 79.52 0.58 1.01 8.04 13.94 3.77 6.54
25
+ iabt 33.31 75.10 52.14 69.43 2.06 2.74 14.84 19.76 8.12 10.81
26
+ iabv 22.41 84.94 66.09 77.81 0.19 0.23 17.68 20.82 1.16 1.37
27
+ iabw 11.81 65.73 59.04 89.82 1.07 1.63 5.73 8.72 0.96 1.46
28
+ iaby 15.70 86.85 77.84 89.63 4.63 5.33 7.35 8.47 1.65 1.90
29
+ iaca 35.90 89.41 58.00 64.87 0.69 0.77 24.75 27.68 6.66 7.45
30
+ iacb 29.92 95.49 72.17 75.58 5.25 5.49 16.04 16.80 7.28 7.62
31
+ iacd 58.95 54.95 24.42 44.44 1.86 3.39 8.11 14.76 22.42 40.80
32
+ iacf 31.13 311.34 218.19 70.08 3.78 1.21 65.71 21.10 27.44 8.81
33
+ iacg 49.54 581.46 324.42 55.79 31.04 5.34 74.94 12.89 182.10 31.32
34
+ iach 22.17 71.90 58.38 81.20 2.42 3.37 9.74 13.55 3.77 5.25
35
+ iacj 30.67 111.14 79.70 71.71 2.65 2.39 22.31 20.08 9.13 8.21
36
+ iacl 11.11 72.09 67.24 93.27 3.16 4.38 4.02 5.58 0.83 1.15
37
+ iacp 23.29 78.87 64.15 81.34 3.65 4.62 12.25 15.53 2.47 3.13
38
+ iact 37.64 77.53 50.05 64.55 1.70 2.19 20.34 26.23 7.15 9.22
39
+ iacu 18.54 67.00 58.09 86.71 3.51 5.24 6.73 10.04 2.18 3.25
40
+ iacv 13.81 67.96 61.84 90.99 3.26 4.80 5.61 8.26 0.51 0.75
41
+ iacw 9.03 63.90 59.24 92.71 1.11 1.73 4.66 7.29 0.00 0.00
42
+ iacy 28.67 50.91 39.01 76.62 2.69 5.29 6.33 12.44 5.57 10.94
43
+ iacz 17.55 96.50 82.35 85.34 2.79 2.89 11.55 11.97 2.59 2.69
44
+ iadb 13.15 44.38 40.51 91.29 1.97 4.44 3.69 8.32 0.17 0.39
45
+ iadc 26.91 90.45 67.77 74.93 1.67 1.84 21.41 23.67 1.27 1.40
46
+ iadd 82.27 55.02 13.22 24.03 3.47 6.30 3.24 5.88 38.56 70.08
47
+ iade 20.52 73.40 63.36 86.32 5.02 6.84 6.52 8.88 3.53 4.80
48
+ iadf 34.61 64.65 46.42 71.80 4.14 6.40 7.85 12.15 10.38 16.05
49
+ iadh 21.27 390.43 315.92 80.92 8.54 2.19 67.79 17.36 6.72 1.72
50
+ iadi 19.25 77.85 65.22 83.77 2.35 3.02 10.93 14.04 1.70 2.19
51
+ iadl 35.89 57.93 42.07 72.62 4.93 8.51 6.16 10.63 9.70 16.75
52
+ iadn 24.12 56.48 43.96 77.83 1.10 1.95 6.01 10.65 6.51 11.52
53
+ iado 16.04 70.46 61.49 87.27 2.34 3.32 5.38 7.64 3.59 5.09
54
+ iadp 35.01 56.41 42.34 75.05 5.68 10.07 5.91 10.48 8.16 14.47
55
+ iadr 29.64 276.34 200.48 72.55 6.03 2.18 65.78 23.80 10.08 3.65
56
+ iads 24.90 83.44 65.14 78.07 2.48 2.97 9.02 10.81 9.28 11.12
57
+ iadv 38.57 67.11 41.92 62.46 0.69 1.03 20.30 30.25 4.89 7.29
58
+ iadw 13.22 66.43 60.21 90.64 2.57 3.87 5.40 8.12 0.82 1.23
59
+ iaea 21.83 96.69 80.70 83.47 5.12 5.29 12.87 13.32 3.11 3.22
60
+ iaec 42.31 135.03 87.30 64.65 9.41 6.97 23.21 17.19 24.52 18.16
61
+ iaeg 24.37 56.94 46.49 81.64 3.42 6.01 8.86 15.56 1.59 2.80
62
+ iaeh 17.45 65.21 55.41 84.97 1.58 2.42 5.67 8.69 4.13 6.34
63
+ iaej 8.71 57.45 53.49 93.11 1.04 1.82 3.24 5.65 0.72 1.25
64
+ iaem 24.77 57.13 44.64 78.14 1.67 2.92 6.42 11.23 6.07 10.63
65
+ iaeo 20.12 56.20 46.37 82.51 1.48 2.63 9.25 16.45 0.58 1.04
66
+ iaeq 26.54 151.02 118.28 78.32 7.34 4.86 11.73 7.77 21.00 13.91
67
+ iaer 28.96 192.23 137.25 71.40 0.69 0.36 46.53 24.20 8.45 4.40
68
+ iaev 12.66 71.39 63.11 88.40 0.76 1.06 6.27 8.78 2.01 2.82
69
+ iaew 19.03 57.23 52.15 91.13 5.81 10.16 4.08 7.13 1.00 1.74
70
+ iaey 18.51 71.81 64.40 89.68 5.89 8.20 6.15 8.56 1.26 1.76
71
+ iaez 31.91 141.98 103.06 72.58 6.38 4.49 25.36 17.86 13.56 9.55
72
+ iafa 23.79 57.79 45.66 79.02 1.62 2.80 5.70 9.86 6.43 11.12
73
+ iafc 24.41 88.38 71.59 81.00 4.78 5.41 11.32 12.81 5.47 6.19
74
+ iafd 27.84 62.12 46.39 74.68 1.57 2.52 9.40 15.13 6.33 10.19
75
+ iafe 37.72 283.67 188.02 66.28 11.34 4.00 79.05 27.87 16.60 5.85
76
+ iafg 33.50 74.02 49.88 67.39 0.66 0.89 18.20 24.58 5.94 8.03
77
+ iafh 61.67 109.81 58.71 53.47 16.63 15.14 14.91 13.58 36.19 32.96
78
+ iafi 24.83 74.67 57.46 76.96 1.33 1.79 14.75 19.75 2.46 3.29
79
+ iafl 33.91 86.42 60.03 69.47 2.92 3.38 21.27 24.61 5.12 5.92
80
+ iafm 13.93 58.24 51.85 89.02 1.72 2.95 3.54 6.08 2.85 4.90
81
+ iafn 40.08 367.71 229.33 62.37 8.99 2.45 103.21 28.07 35.17 9.57
82
+ iafp 29.63 298.85 225.23 75.37 14.94 5.00 40.64 13.60 32.99 11.04
83
+ iafr 26.35 122.14 103.16 84.46 13.21 10.81 10.93 8.95 8.05 6.59
84
+ iafs 38.18 111.66 76.36 68.38 7.33 6.56 22.05 19.75 13.25 11.86
85
+ iaft 18.26 65.79 54.14 82.29 0.36 0.55 10.31 15.67 1.34 2.04
86
+ iafu 28.13 85.37 65.05 76.19 3.69 4.32 8.61 10.09 11.71 13.72
87
+ iafv 15.10 88.81 76.42 86.05 1.02 1.14 10.77 12.12 1.63 1.83
88
+ iafw 40.49 64.51 40.03 62.05 1.64 2.54 14.49 22.47 9.99 15.48
89
+ iafx 46.94 130.12 70.80 54.42 1.77 1.36 39.24 30.16 20.07 15.43
90
+ iafy 14.44 65.16 56.78 87.14 1.03 1.58 8.36 12.83 0.02 0.03
91
+ iaga 38.37 86.82 54.36 62.61 0.85 0.98 24.12 27.78 8.34 9.60
92
+ iagc 49.92 631.63 363.19 57.50 46.84 7.42 75.28 11.92 193.17 30.58
93
+ iagd 35.96 70.09 46.41 66.22 1.53 2.18 8.44 12.04 15.24 21.75
94
+ iagf 20.50 54.83 45.49 82.96 1.90 3.46 2.59 4.73 6.75 12.31
95
+ iagg 12.86 338.28 306.76 90.68 11.97 3.54 18.02 5.33 13.51 3.99
96
+ iagj 35.89 388.50 260.57 67.07 11.50 2.96 103.59 26.67 24.33 6.26
97
+ iagk 16.38 85.67 73.03 85.25 1.39 1.63 10.86 12.67 1.78 2.08
98
+ iagl 28.89 61.26 50.59 82.59 7.03 11.48 2.77 4.52 7.90 12.89
99
+ iago 13.71 67.12 58.15 86.63 0.23 0.34 8.10 12.07 0.87 1.30
100
+ iagq 23.12 60.02 52.20 86.97 6.06 10.10 4.82 8.04 2.99 4.99
101
+ iagv 24.33 286.20 220.73 77.12 4.17 1.46 47.59 16.63 17.88 6.25
102
+ iagx 56.19 383.32 173.37 45.23 5.44 1.42 88.22 23.01 121.73 31.76
103
+ iagy 34.59 338.66 233.32 68.89 11.81 3.49 72.24 21.33 33.11 9.78
104
+ iaha 22.30 67.80 56.83 83.82 4.15 6.12 9.58 14.13 1.39 2.05
105
+ iahb 39.31 457.31 294.81 64.47 17.28 3.78 72.96 15.95 89.54 19.58
106
+ iahc 13.91 106.42 95.57 89.80 3.96 3.72 7.94 7.47 2.91 2.73
107
+ iahe 15.87 315.58 273.40 86.63 7.90 2.50 39.33 12.46 2.85 0.90
108
+ iahh 16.32 67.10 58.93 87.83 2.78 4.14 6.70 9.98 1.47 2.19
109
+ iahk 19.39 253.63 210.56 83.02 6.12 2.41 30.62 12.07 12.44 4.91
110
+ iahl 28.99 52.35 43.06 82.25 5.89 11.24 1.94 3.71 7.35 14.04
111
+ iahm 15.73 65.43 59.12 90.35 3.98 6.08 6.18 9.44 0.13 0.20
112
+ iahn 23.24 123.21 102.05 82.82 7.48 6.07 10.97 8.91 10.19 8.27
113
+ iaht 12.73 61.02 55.27 90.58 2.02 3.30 4.68 7.67 1.07 1.75
114
+ iahx 27.05 76.43 58.04 75.95 2.29 3.00 15.20 19.89 3.18 4.16
115
+ iahz 9.78 86.79 79.43 91.52 1.13 1.30 7.26 8.36 0.10 0.12
116
+ iaic 18.44 54.84 45.28 82.56 0.55 1.00 8.63 15.74 0.93 1.70
117
+ iaif 20.86 373.38 303.62 81.32 8.11 2.17 54.38 14.57 15.38 4.12
118
+ iaih 39.43 84.54 52.67 62.30 1.46 1.73 21.07 24.92 10.80 12.78
119
+ iaij 57.97 425.99 200.83 47.14 21.77 5.11 125.23 29.40 99.93 23.46
120
+ iaim 36.57 63.55 46.00 72.38 5.68 8.94 5.23 8.23 12.33 19.40
121
+ iain 14.75 74.91 64.63 86.28 0.77 1.03 9.82 13.10 0.46 0.62
122
+ iaip 23.75 425.77 341.05 80.10 16.38 3.85 30.49 7.16 54.23 12.74
123
+ iaiq 20.25 288.95 249.63 86.39 19.19 6.64 21.87 7.57 17.45 6.04
124
+ iair 28.03 62.84 47.08 74.93 1.86 2.95 12.00 19.09 3.76 5.99
125
+ iaix 39.02 56.79 38.64 68.04 4.01 7.06 7.44 13.10 10.71 18.86
126
+ iaiy 39.63 146.05 90.38 61.88 2.21 1.52 19.07 13.06 36.60 25.06
127
+ iaja 25.07 85.67 64.97 75.84 0.78 0.91 19.51 22.77 1.19 1.39
128
+ iajb 22.67 182.24 144.64 79.37 3.70 2.03 31.00 17.01 6.60 3.62
129
+ iajc 31.72 58.74 40.76 69.40 0.66 1.12 13.13 22.35 4.85 8.26
130
+ iaje 37.21 58.71 38.58 65.71 1.71 2.92 6.98 11.89 13.15 22.40
131
+ iajg 34.27 177.43 122.59 69.09 5.97 3.37 29.97 16.89 24.86 14.01
132
+ iaji 30.40 78.34 58.24 74.35 3.71 4.74 15.33 19.57 4.77 6.08
133
+ iajk 30.39 92.21 68.49 74.28 4.31 4.67 15.30 16.59 8.42 9.14
134
+ iajl 11.74 58.66 53.58 91.33 1.80 3.08 3.71 6.33 1.37 2.33
135
+ iajm 14.81 62.31 55.80 89.56 2.72 4.36 6.02 9.66 0.49 0.79
136
+ iajn 25.38 232.31 180.39 77.65 7.04 3.03 29.85 12.85 22.08 9.50
137
+ iajq 66.45 172.33 86.22 50.03 28.41 16.48 51.92 30.13 34.20 19.84
138
+ iajs 21.46 200.82 166.75 83.03 9.03 4.50 22.43 11.17 11.64 5.80
139
+ iaju 24.91 102.17 78.70 77.02 1.97 1.93 15.72 15.39 7.76 7.59
140
+ iajv 21.11 75.33 60.85 80.77 1.42 1.89 13.13 17.43 1.35 1.80
141
+ iajw 11.16 80.53 73.27 90.99 1.73 2.15 6.59 8.19 0.66 0.82
142
+ iajx 29.20 63.21 45.60 72.14 0.85 1.34 9.91 15.67 7.70 12.19
143
+ iakb 20.07 80.15 64.45 80.41 0.38 0.48 13.44 16.77 2.26 2.82
144
+ iakc 17.63 73.70 63.06 85.56 2.35 3.18 9.37 12.72 1.27 1.72
145
+ iakd 23.93 72.78 55.58 76.37 0.22 0.30 15.56 21.38 1.64 2.25
146
+ iakf 18.77 218.21 185.44 84.98 8.18 3.75 25.63 11.74 7.14 3.27
147
+ iakg 31.97 160.03 109.97 68.72 1.09 0.68 47.54 29.71 2.52 1.58
148
+ iaki 22.55 184.77 154.28 83.50 11.17 6.05 17.54 9.49 12.95 7.01
149
+ iakl 13.84 70.73 65.00 91.89 4.06 5.74 4.79 6.77 0.94 1.33
150
+ iakm 21.25 62.98 50.84 80.72 1.24 1.98 10.19 16.18 1.95 3.10
151
+ iakn 20.33 164.25 133.48 81.27 2.62 1.59 27.21 16.56 3.56 2.17
152
+ iakr 29.81 206.86 161.67 78.15 16.47 7.96 10.86 5.25 34.33 16.60
153
+ iala 33.84 89.76 59.97 66.81 0.58 0.65 26.47 29.49 3.32 3.70
154
+ ialb 54.83 171.27 81.75 47.73 4.38 2.56 63.25 36.93 26.27 15.34
155
+ ialc 14.24 74.18 64.20 86.54 0.58 0.78 8.48 11.43 1.51 2.03
156
+ iale 27.94 49.93 36.98 74.07 1.00 2.01 7.28 14.58 5.67 11.35
157
+ ialh 23.15 121.18 95.26 78.61 2.14 1.77 22.90 18.89 3.02 2.49
158
+ iali 21.55 111.75 89.68 80.25 2.02 1.81 18.31 16.38 3.76 3.36
159
+ ialj 22.04 92.54 77.65 83.91 5.51 5.95 10.13 10.95 4.76 5.14
160
+ ialk 28.27 589.43 450.54 76.44 27.74 4.71 83.72 14.20 55.17 9.36
161
+ iall 18.62 200.77 167.65 83.50 4.26 2.12 19.46 9.69 13.66 6.81
162
+ ialo 24.79 77.35 59.10 76.41 0.93 1.20 18.00 23.28 0.24 0.31
163
+ ialp 34.05 79.91 53.16 66.52 0.46 0.57 20.76 25.98 5.99 7.49
164
+ ialq 8.40 64.89 60.91 93.87 1.47 2.26 3.95 6.09 0.03 0.04
165
+ ialr 23.59 71.87 55.13 76.71 0.21 0.29 9.04 12.57 7.71 10.72
166
+ ials 19.75 77.06 62.77 81.46 0.93 1.21 8.48 11.01 5.81 7.53
167
+ ialt 23.14 93.40 74.65 79.92 2.85 3.06 13.79 14.76 4.97 5.32
168
+ ialv 19.38 63.72 53.41 83.81 2.04 3.20 7.30 11.46 3.01 4.73
169
+ ialw 20.72 40.10 36.09 89.99 4.29 10.71 2.22 5.54 1.79 4.47
170
+ ialx 85.31 71.61 11.19 15.63 0.67 0.94 22.15 30.93 38.27 53.45
171
+ iamg 39.49 790.99 488.09 61.71 9.48 1.20 225.46 28.50 77.44 9.79
172
+ iamh 39.27 56.73 41.60 73.33 7.15 12.60 4.16 7.33 10.97 19.33
173
+ iami 26.49 52.00 42.98 82.65 4.75 9.14 6.70 12.89 2.32 4.46
174
+ iamk 16.55 66.92 58.38 87.25 2.54 3.80 6.04 9.03 2.49 3.72
175
+ iaml 59.96 125.23 54.48 43.50 4.34 3.47 19.92 15.91 50.83 40.59
176
+ iamp 16.95 63.80 55.93 87.66 2.94 4.61 5.76 9.02 2.12 3.32
177
+ iamr 43.63 86.47 53.39 61.75 4.65 5.38 10.36 11.98 22.72 26.28
178
+ iams 31.84 362.50 262.54 72.43 15.46 4.27 63.21 17.44 36.75 10.14
179
+ iamu 32.32 134.32 105.29 78.39 14.38 10.71 15.39 11.46 13.63 10.15
180
+ iamv 14.34 81.30 71.22 87.60 1.58 1.94 9.40 11.57 0.67 0.83
181
+ iamw 27.87 698.29 523.08 74.91 19.38 2.77 152.57 21.85 22.64 3.24
182
+ iamz 25.85 69.95 53.66 76.71 1.80 2.57 14.02 20.04 2.27 3.25
183
+ ianb 21.36 348.27 283.75 81.47 9.88 2.84 50.34 14.45 14.18 4.07
184
+ iand 22.84 90.71 78.98 87.07 8.99 9.91 6.38 7.04 5.34 5.89
185
+ ianf 14.12 93.90 82.86 88.24 2.22 2.36 11.00 11.71 0.04 0.04
186
+ iang 32.81 60.59 44.18 72.91 3.47 5.73 4.42 7.30 11.99 19.79
187
+ ianh 19.56 61.13 50.22 82.15 1.04 1.71 7.63 12.49 3.28 5.36
188
+ ianj 38.46 121.69 75.92 62.39 1.03 0.85 36.47 29.97 9.30 7.64
189
+ ianp 31.35 55.40 41.24 74.43 3.20 5.78 4.18 7.55 9.98 18.02
190
+ ianq 15.43 104.48 95.32 91.23 6.96 6.66 7.11 6.81 2.05 1.96
191
+ ianr 38.89 274.84 175.38 63.81 7.43 2.70 79.12 28.79 20.35 7.40
192
+ ians 21.19 272.42 221.36 81.26 6.66 2.44 25.71 9.44 25.35 9.30
193
+ ianv 36.23 250.98 167.91 66.90 7.86 3.13 54.69 21.79 28.39 11.31
194
+ ianx 25.28 128.56 97.36 75.73 1.29 1.01 29.40 22.87 1.80 1.40
195
+ iaob 28.55 70.89 52.15 73.57 1.50 2.11 17.65 24.89 1.09 1.54
196
+ iaoe 29.40 59.76 42.67 71.40 0.48 0.80 16.20 27.10 0.89 1.49
197
+ iaog 19.02 67.08 54.96 81.93 0.64 0.95 9.41 14.03 2.71 4.04
198
+ iaoi 23.23 82.96 65.76 79.26 2.06 2.49 17.12 20.63 0.09 0.10
199
+ iaoj 16.44 80.32 71.51 89.03 4.39 5.47 7.81 9.73 1.00 1.24
200
+ iaom 39.24 101.10 62.71 62.03 1.28 1.27 25.21 24.94 13.18 13.03
201
+ iaon 10.06 210.46 194.81 92.56 5.52 2.62 13.71 6.52 1.94 0.92
202
+ iaop 46.70 263.53 146.17 55.47 5.70 2.16 67.41 25.58 49.95 18.95
203
+ iaos 25.42 249.10 193.43 77.65 7.64 3.07 47.05 18.89 8.62 3.46
204
+ iaou 17.44 55.57 49.38 88.86 3.50 6.31 5.24 9.44 0.95 1.70
205
+ iaov 32.69 163.78 119.43 72.92 9.19 5.61 34.80 21.25 9.55 5.83
206
+ iaoz 23.16 86.45 69.51 80.40 3.08 3.56 13.93 16.11 3.01 3.49
207
+ iapa 43.07 75.10 42.76 56.94 0.01 0.01 22.90 30.49 9.44 12.57
208
+ iapb 20.69 64.86 52.71 81.27 1.27 1.96 10.29 15.86 1.86 2.87
209
+ iapc 36.12 44.33 34.57 77.99 6.26 14.11 6.07 13.69 3.69 8.32
210
+ iapg 45.04 61.14 35.35 57.82 1.75 2.86 16.35 26.74 9.44 15.44
211
+ iapj 20.10 54.77 46.34 84.61 2.58 4.72 7.55 13.79 0.87 1.60
212
+ iapl 39.60 65.58 47.19 71.96 7.58 11.56 15.70 23.94 2.69 4.10
213
+ iapq 28.86 112.62 86.43 76.74 6.31 5.60 12.84 11.40 13.36 11.86
214
+ iapt 26.02 120.35 91.30 75.86 2.26 1.88 12.15 10.09 16.91 14.05
215
+ iaqb 37.26 100.33 76.20 75.95 13.26 13.22 14.41 14.37 9.71 9.68
216
+ iaqd 36.73 107.02 71.02 66.36 3.31 3.09 18.11 16.92 17.89 16.72
217
+ iaqo 35.20 149.00 100.03 67.14 3.49 2.34 35.90 24.09 13.07 8.77
218
+ iaqp 26.04 66.56 50.52 75.90 1.29 1.94 10.19 15.30 5.85 8.80
219
+ iaqq 36.03 54.92 37.17 67.68 2.04 3.71 6.42 11.68 11.33 20.64
220
+ iaqr 22.88 71.79 57.07 79.49 1.70 2.37 11.36 15.82 3.36 4.68
221
+ iaqt 16.08 78.57 67.32 85.69 1.38 1.76 10.41 13.25 0.83 1.06
222
+ iaqv 37.61 80.44 51.09 63.52 0.91 1.13 14.83 18.43 14.52 18.05
223
+ iaqw 17.21 523.30 439.10 83.91 5.84 1.12 75.12 14.36 9.08 1.74
224
+ iaqy 59.73 56.61 28.15 49.73 5.36 9.46 5.40 9.54 23.05 40.73
225
+ iaqz 42.53 189.24 114.22 60.36 5.46 2.88 42.66 22.54 32.37 17.10
226
+ iara 26.10 85.36 63.09 73.91 0.01 0.01 11.61 13.60 10.66 12.49
227
+ iarb 78.90 64.96 18.32 28.21 4.62 7.11 9.92 15.28 36.71 56.52
228
+ iarc 28.42 75.15 54.32 72.28 0.52 0.70 17.39 23.14 3.44 4.58
229
+ iare 8.87 78.16 72.50 92.75 1.27 1.62 4.69 6.00 0.98 1.25
230
+ iari 30.61 71.83 50.95 70.92 1.11 1.54 9.42 13.11 11.47 15.96
231
+ iarj 31.43 80.83 56.70 70.15 1.27 1.58 17.27 21.37 6.86 8.48
232
+ iarm 21.36 130.15 104.55 80.33 2.20 1.69 21.73 16.70 3.86 2.97
233
+ iarn 18.92 75.98 65.42 86.11 3.82 5.03 8.74 11.50 1.82 2.39
234
+ iarp 37.88 73.62 47.17 64.08 1.44 1.96 15.85 21.53 10.60 14.40
235
+ iarq 48.22 128.41 70.64 55.01 4.14 3.23 26.42 20.58 31.35 24.41
236
+ iart 43.10 110.02 62.87 57.14 0.26 0.24 44.98 40.88 2.17 1.97
237
+ iarw 19.30 71.95 61.19 85.04 3.13 4.35 8.00 11.12 2.76 3.84
238
+ iarx 20.92 75.51 60.36 79.94 0.65 0.86 13.70 18.15 1.44 1.91
239
+ iary 22.84 92.82 72.90 78.54 1.28 1.38 13.76 14.82 6.16 6.64
240
+ iarz 28.51 78.08 56.23 72.02 0.42 0.53 13.00 16.65 8.84 11.32
241
+ iasa 37.80 57.47 38.19 66.45 2.44 4.25 12.36 21.50 6.92 12.05
242
+ iasb 15.80 79.10 70.26 88.82 3.65 4.62 4.72 5.97 4.12 5.20
243
+ iasf 28.95 85.51 64.74 75.71 3.98 4.65 13.45 15.73 7.32 8.57
244
+ iash 51.45 236.98 160.62 67.78 45.56 19.23 27.00 11.40 49.36 20.83
245
+ iasl 11.16 72.28 66.64 92.19 2.42 3.35 4.84 6.69 0.80 1.11
246
+ iasn 35.77 86.26 68.28 79.16 12.88 14.93 9.87 11.44 8.11 9.40
247
+ iass 45.67 110.58 73.66 66.62 13.59 12.29 22.04 19.93 14.87 13.45
248
+ iasv 26.05 50.19 40.06 79.82 2.95 5.87 4.87 9.71 5.25 10.46
249
+ iasx 39.74 92.06 56.24 61.09 0.76 0.82 18.65 20.26 17.17 18.65
250
+ iasy 43.15 89.42 51.66 57.78 0.82 0.92 28.60 31.98 9.16 10.24
251
+ iata 25.26 59.21 46.42 78.40 2.17 3.66 6.08 10.26 6.71 11.34
252
+ iatd 17.94 72.05 64.99 90.20 5.87 8.14 3.73 5.18 3.33 4.62
253
+ iatf 47.55 63.81 34.14 53.50 0.67 1.05 12.39 19.41 17.29 27.09
254
+ TOTAL 30.24 32224.95 23677.80 73.48 1196.56 3.71 5433.78 16.86 3113.37 9.66
reproducible_research/2022.07/CALLHOME.SpeakerDiarization.CALLHOME.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.eval ADDED
@@ -0,0 +1,263 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ DH_EVAL_0001 13.64 485.12 434.13 89.49 15.15 3.12 12.69 2.62 38.30 7.90
5
+ DH_EVAL_0002 30.86 57.09 42.30 74.09 2.83 4.95 8.97 15.72 5.82 10.19
6
+ DH_EVAL_0003 13.76 620.30 552.74 89.11 17.81 2.87 49.58 7.99 17.98 2.90
7
+ DH_EVAL_0004 19.74 332.41 285.48 85.88 18.68 5.62 24.18 7.28 22.74 6.84
8
+ DH_EVAL_0005 19.16 573.48 481.81 84.02 18.23 3.18 58.73 10.24 32.94 5.74
9
+ DH_EVAL_0006 9.81 636.34 593.94 93.34 20.04 3.15 36.13 5.68 6.27 0.98
10
+ DH_EVAL_0007 16.30 589.92 524.44 88.90 30.65 5.20 45.10 7.64 20.39 3.46
11
+ DH_EVAL_0008 9.78 602.91 561.72 93.17 17.75 2.94 29.85 4.95 11.34 1.88
12
+ DH_EVAL_0009 48.79 755.88 410.03 54.25 22.94 3.03 242.08 32.03 103.77 13.73
13
+ DH_EVAL_0010 9.61 291.89 277.39 95.03 13.55 4.64 13.11 4.49 1.39 0.48
14
+ DH_EVAL_0011 9.95 607.06 562.41 92.64 15.74 2.59 40.48 6.67 4.17 0.69
15
+ DH_EVAL_0012 15.95 592.15 512.57 86.56 14.89 2.51 45.37 7.66 34.21 5.78
16
+ DH_EVAL_0013 6.84 477.50 465.12 97.41 20.27 4.25 12.37 2.59 0.00 0.00
17
+ DH_EVAL_0014 31.58 477.45 410.18 85.91 83.53 17.49 42.29 8.86 24.98 5.23
18
+ DH_EVAL_0015 48.56 762.02 442.93 58.13 50.95 6.69 158.42 20.79 160.66 21.08
19
+ DH_EVAL_0016 17.93 540.07 477.34 88.38 34.13 6.32 54.21 10.04 8.52 1.58
20
+ DH_EVAL_0017 79.25 35.76 12.62 35.28 5.20 14.53 8.56 23.93 14.59 40.80
21
+ DH_EVAL_0018 73.53 43.45 30.39 69.94 18.89 43.47 7.14 16.42 5.92 13.63
22
+ DH_EVAL_0019 84.23 126.36 24.63 19.49 4.71 3.72 37.94 30.02 63.80 50.49
23
+ DH_EVAL_0020 71.14 37.74 19.39 51.38 8.50 22.52 2.90 7.69 15.45 40.93
24
+ DH_EVAL_0021 23.89 184.91 150.28 81.27 9.54 5.16 9.96 5.39 24.67 13.34
25
+ DH_EVAL_0022 13.85 568.52 513.83 90.38 24.07 4.23 45.61 8.02 9.09 1.60
26
+ DH_EVAL_0023 18.27 160.43 137.77 85.87 6.64 4.14 6.20 3.87 16.46 10.26
27
+ DH_EVAL_0024 23.32 199.68 166.21 83.24 13.10 6.56 16.12 8.07 17.34 8.69
28
+ DH_EVAL_0025 61.95 455.93 200.10 43.89 26.61 5.84 142.55 31.27 113.28 24.85
29
+ DH_EVAL_0026 14.01 654.77 581.15 88.76 18.11 2.77 58.75 8.97 14.87 2.27
30
+ DH_EVAL_0027 7.50 518.95 499.57 96.27 19.52 3.76 15.04 2.90 4.34 0.84
31
+ DH_EVAL_0028 17.36 583.60 505.64 86.64 23.36 4.00 52.44 8.99 25.52 4.37
32
+ DH_EVAL_0029 13.62 590.53 532.19 90.12 22.12 3.75 46.64 7.90 11.69 1.98
33
+ DH_EVAL_0030 15.92 566.56 504.21 88.99 27.86 4.92 54.94 9.70 7.41 1.31
34
+ DH_EVAL_0031 110.28 71.66 14.21 19.83 21.57 30.11 20.15 28.12 37.30 52.05
35
+ DH_EVAL_0032 10.01 657.21 605.73 92.17 14.29 2.17 40.85 6.22 10.63 1.62
36
+ DH_EVAL_0033 16.63 591.01 511.78 86.59 19.05 3.22 22.51 3.81 56.72 9.60
37
+ DH_EVAL_0034 81.04 69.69 13.52 19.39 0.31 0.44 34.57 49.61 21.60 30.99
38
+ DH_EVAL_0035 14.10 706.42 626.61 88.70 19.79 2.80 69.75 9.87 10.05 1.42
39
+ DH_EVAL_0036 14.48 580.54 517.50 89.14 20.99 3.62 48.66 8.38 14.39 2.48
40
+ DH_EVAL_0037 34.94 680.00 467.02 68.68 24.64 3.62 150.11 22.08 62.87 9.25
41
+ DH_EVAL_0038 10.57 494.15 489.32 99.02 47.39 9.59 4.83 0.98 0.00 0.00
42
+ DH_EVAL_0039 57.31 298.43 161.66 54.17 34.26 11.48 8.50 2.85 128.26 42.98
43
+ DH_EVAL_0040 4.59 457.68 443.42 96.88 6.74 1.47 14.26 3.12 0.00 0.00
44
+ DH_EVAL_0041 14.82 292.41 257.77 88.15 8.69 2.97 33.78 11.55 0.86 0.30
45
+ DH_EVAL_0042 21.41 191.80 163.09 85.03 12.36 6.44 5.25 2.74 23.46 12.23
46
+ DH_EVAL_0043 5.86 499.03 483.28 96.84 13.50 2.71 14.72 2.95 1.03 0.21
47
+ DH_EVAL_0044 54.77 815.76 394.33 48.34 25.37 3.11 257.98 31.62 163.45 20.04
48
+ DH_EVAL_0045 24.51 172.29 134.83 78.26 4.78 2.78 15.06 8.74 22.39 13.00
49
+ DH_EVAL_0046 11.57 328.89 304.32 92.53 13.49 4.10 14.27 4.34 10.29 3.13
50
+ DH_EVAL_0047 25.12 339.21 262.03 77.25 8.03 2.37 40.80 12.03 36.39 10.73
51
+ DH_EVAL_0048 13.32 567.22 512.51 90.36 20.82 3.67 36.96 6.52 17.75 3.13
52
+ DH_EVAL_0049 13.35 188.96 175.94 93.11 12.20 6.45 10.33 5.47 2.69 1.42
53
+ DH_EVAL_0050 12.22 270.79 246.33 90.97 8.62 3.18 10.15 3.75 14.31 5.28
54
+ DH_EVAL_0051 19.18 165.04 140.56 85.17 7.18 4.35 10.34 6.27 14.14 8.57
55
+ DH_EVAL_0052 49.67 313.46 167.76 53.52 10.00 3.19 26.53 8.46 119.17 38.02
56
+ DH_EVAL_0053 69.08 26.88 10.06 37.42 1.75 6.51 2.30 8.57 14.52 54.00
57
+ DH_EVAL_0054 6.84 182.73 176.82 96.77 6.59 3.61 5.81 3.18 0.10 0.05
58
+ DH_EVAL_0055 23.28 175.70 145.47 82.79 10.68 6.08 15.70 8.94 14.53 8.27
59
+ DH_EVAL_0056 44.95 635.51 416.64 65.56 66.82 10.51 155.63 24.49 63.24 9.95
60
+ DH_EVAL_0057 30.47 221.64 158.07 71.32 3.96 1.79 45.03 20.32 18.53 8.36
61
+ DH_EVAL_0058 12.20 199.27 180.95 90.80 5.99 3.01 4.56 2.29 13.77 6.91
62
+ DH_EVAL_0059 22.58 207.01 171.15 82.68 10.88 5.26 17.70 8.55 18.16 8.77
63
+ DH_EVAL_0060 27.25 187.39 147.36 78.64 11.03 5.89 8.90 4.75 31.13 16.61
64
+ DH_EVAL_0061 78.47 131.91 29.88 22.65 1.48 1.12 45.43 34.44 56.59 42.91
65
+ DH_EVAL_0062 11.30 628.11 571.54 90.99 14.39 2.29 54.05 8.61 2.52 0.40
66
+ DH_EVAL_0063 60.51 61.40 43.70 71.18 19.46 31.69 2.81 4.58 14.89 24.25
67
+ DH_EVAL_0064 22.01 281.16 231.41 82.31 12.13 4.31 31.34 11.15 18.41 6.55
68
+ DH_EVAL_0065 13.14 538.86 499.60 92.71 31.52 5.85 33.86 6.28 5.41 1.00
69
+ DH_EVAL_0066 14.34 513.98 442.10 86.01 1.80 0.35 70.14 13.65 1.74 0.34
70
+ DH_EVAL_0067 91.97 89.93 19.27 21.43 12.05 13.40 18.22 20.26 52.43 58.31
71
+ DH_EVAL_0068 9.91 602.26 562.68 93.43 20.12 3.34 30.04 4.99 9.54 1.58
72
+ DH_EVAL_0069 16.60 210.09 183.80 87.49 8.59 4.09 14.92 7.10 11.37 5.41
73
+ DH_EVAL_0070 15.14 222.35 197.24 88.70 8.55 3.85 5.70 2.56 19.42 8.74
74
+ DH_EVAL_0071 8.93 556.11 522.32 93.93 15.85 2.85 17.33 3.12 16.46 2.96
75
+ DH_EVAL_0072 10.53 449.80 417.99 92.93 15.57 3.46 21.37 4.75 10.44 2.32
76
+ DH_EVAL_0073 47.64 174.24 95.53 54.82 4.29 2.46 16.13 9.26 62.59 35.92
77
+ DH_EVAL_0074 19.98 209.73 172.12 82.07 4.28 2.04 28.90 13.78 8.71 4.15
78
+ DH_EVAL_0075 9.51 158.31 151.69 95.82 8.43 5.33 5.54 3.50 1.08 0.68
79
+ DH_EVAL_0076 15.40 574.21 501.38 87.32 15.57 2.71 66.42 11.57 6.40 1.12
80
+ DH_EVAL_0077 6.00 434.09 427.98 98.59 19.95 4.59 6.11 1.41 0.00 0.00
81
+ DH_EVAL_0078 39.59 286.43 173.59 60.60 0.55 0.19 100.91 35.23 11.94 4.17
82
+ DH_EVAL_0079 13.62 579.85 523.77 90.33 22.90 3.95 47.82 8.25 8.27 1.43
83
+ DH_EVAL_0080 13.10 626.21 564.34 90.12 20.17 3.22 52.36 8.36 9.50 1.52
84
+ DH_EVAL_0081 2.34 506.63 502.24 99.13 7.45 1.47 4.39 0.87 0.00 0.00
85
+ DH_EVAL_0082 13.87 483.43 443.64 91.77 27.29 5.64 15.57 3.22 24.21 5.01
86
+ DH_EVAL_0083 31.46 187.11 137.33 73.39 9.08 4.85 12.55 6.70 37.24 19.90
87
+ DH_EVAL_0084 7.36 441.20 425.88 96.53 17.15 3.89 11.09 2.51 4.22 0.96
88
+ DH_EVAL_0085 42.59 443.64 281.33 63.41 26.62 6.00 96.95 21.85 65.35 14.73
89
+ DH_EVAL_0086 155.72 73.04 22.59 30.93 63.28 86.64 6.53 8.95 43.91 60.13
90
+ DH_EVAL_0087 14.79 603.48 534.27 88.53 20.02 3.32 56.03 9.28 13.18 2.18
91
+ DH_EVAL_0088 16.44 625.73 548.80 87.71 25.93 4.14 71.81 11.48 5.12 0.82
92
+ DH_EVAL_0089 10.13 598.85 554.77 92.64 16.60 2.77 36.13 6.03 7.95 1.33
93
+ DH_EVAL_0090 49.34 577.35 326.05 56.47 33.58 5.82 37.00 6.41 214.29 37.12
94
+ DH_EVAL_0091 12.37 605.49 542.06 89.52 11.45 1.89 47.51 7.85 15.92 2.63
95
+ DH_EVAL_0092 11.87 430.60 396.14 92.00 16.64 3.86 25.17 5.85 9.28 2.16
96
+ DH_EVAL_0093 9.99 606.31 561.06 92.54 15.34 2.53 40.56 6.69 4.69 0.77
97
+ DH_EVAL_0094 19.30 309.12 260.47 84.26 11.01 3.56 39.84 12.89 8.81 2.85
98
+ DH_EVAL_0095 45.81 109.27 63.81 58.40 4.60 4.21 40.01 36.62 5.44 4.98
99
+ DH_EVAL_0096 15.30 263.16 234.77 89.21 11.89 4.52 27.17 10.32 1.22 0.46
100
+ DH_EVAL_0097 28.20 171.83 130.27 75.81 6.91 4.02 14.58 8.48 26.98 15.70
101
+ DH_EVAL_0098 22.73 331.49 283.62 85.56 27.48 8.29 36.32 10.96 11.55 3.49
102
+ DH_EVAL_0099 6.50 519.35 503.05 96.86 17.46 3.36 10.34 1.99 5.97 1.15
103
+ DH_EVAL_0100 47.36 730.43 458.49 62.77 73.98 10.13 206.00 28.20 65.93 9.03
104
+ DH_EVAL_0101 9.49 321.80 306.48 95.24 15.22 4.73 14.87 4.62 0.45 0.14
105
+ DH_EVAL_0102 21.67 180.18 154.46 85.73 13.33 7.40 11.91 6.61 13.81 7.67
106
+ DH_EVAL_0103 12.00 259.55 243.05 93.64 14.65 5.65 15.12 5.83 1.38 0.53
107
+ DH_EVAL_0104 20.77 153.47 127.17 82.86 5.57 3.63 14.82 9.66 11.48 7.48
108
+ DH_EVAL_0105 57.78 186.93 104.36 55.83 25.44 13.61 36.64 19.60 45.93 24.57
109
+ DH_EVAL_0106 12.24 596.35 538.13 90.24 14.75 2.47 41.89 7.02 16.33 2.74
110
+ DH_EVAL_0107 8.91 406.62 384.21 94.49 13.80 3.39 18.42 4.53 3.99 0.98
111
+ DH_EVAL_0108 10.31 519.95 480.03 92.32 13.70 2.64 32.31 6.21 7.61 1.46
112
+ DH_EVAL_0109 12.87 625.42 566.49 90.58 21.59 3.45 45.83 7.33 13.09 2.09
113
+ DH_EVAL_0110 15.67 593.70 515.84 86.89 15.20 2.56 62.73 10.57 15.13 2.55
114
+ DH_EVAL_0111 40.13 809.82 515.65 63.68 30.85 3.81 210.76 26.03 83.41 10.30
115
+ DH_EVAL_0112 54.93 106.94 61.86 57.85 13.66 12.78 14.86 13.90 30.22 28.25
116
+ DH_EVAL_0113 9.60 224.39 209.21 93.23 6.36 2.83 13.37 5.96 1.82 0.81
117
+ DH_EVAL_0114 13.05 593.40 531.97 89.65 16.03 2.70 50.11 8.44 11.33 1.91
118
+ DH_EVAL_0115 27.04 545.53 462.02 84.69 63.99 11.73 67.14 12.31 16.37 3.00
119
+ DH_EVAL_0116 92.16 145.80 13.83 9.49 2.40 1.65 79.20 54.32 52.76 36.19
120
+ DH_EVAL_0117 32.26 239.98 174.27 72.62 11.69 4.87 22.94 9.56 42.77 17.82
121
+ DH_EVAL_0118 15.61 488.21 428.51 87.77 16.51 3.38 44.91 9.20 14.80 3.03
122
+ DH_EVAL_0119 12.77 584.97 532.43 91.02 22.15 3.79 47.58 8.13 4.95 0.85
123
+ DH_EVAL_0120 14.95 295.03 262.27 88.90 11.36 3.85 22.50 7.62 10.26 3.48
124
+ DH_EVAL_0121 19.12 170.72 144.22 84.48 6.14 3.59 16.42 9.62 10.09 5.91
125
+ DH_EVAL_0122 6.09 468.03 448.91 95.92 9.39 2.01 19.12 4.08 0.00 0.00
126
+ DH_EVAL_0123 12.01 588.14 540.66 91.93 23.14 3.93 38.91 6.62 8.57 1.46
127
+ DH_EVAL_0124 11.61 170.28 158.84 93.28 8.34 4.90 3.71 2.18 7.73 4.54
128
+ DH_EVAL_0125 31.23 141.01 105.65 74.92 8.68 6.15 16.98 12.04 18.37 13.03
129
+ DH_EVAL_0126 10.99 596.15 551.76 92.55 21.13 3.54 37.17 6.24 7.22 1.21
130
+ DH_EVAL_0127 17.61 173.47 151.97 87.60 9.05 5.22 10.77 6.21 10.74 6.19
131
+ DH_EVAL_0128 12.84 323.75 287.37 88.76 5.20 1.61 33.82 10.45 2.56 0.79
132
+ DH_EVAL_0129 13.76 665.67 597.46 89.75 23.39 3.51 51.66 7.76 16.56 2.49
133
+ DH_EVAL_0130 18.30 319.60 270.76 84.72 9.65 3.02 35.63 11.15 13.21 4.13
134
+ DH_EVAL_0131 22.53 203.24 166.30 81.83 8.85 4.35 17.44 8.58 19.50 9.59
135
+ DH_EVAL_0132 27.18 230.82 172.56 74.76 4.47 1.94 19.12 8.28 39.15 16.96
136
+ DH_EVAL_0133 22.03 338.47 275.23 81.32 11.34 3.35 48.64 14.37 14.60 4.31
137
+ DH_EVAL_0134 10.62 564.46 524.19 92.87 19.68 3.49 35.26 6.25 5.01 0.89
138
+ DH_EVAL_0135 16.87 220.01 191.46 87.02 8.57 3.89 21.53 9.78 7.03 3.20
139
+ DH_EVAL_0136 12.59 576.15 531.63 92.27 28.05 4.87 37.75 6.55 6.77 1.17
140
+ DH_EVAL_0137 6.00 515.14 493.38 95.78 9.17 1.78 18.16 3.52 3.60 0.70
141
+ DH_EVAL_0138 27.30 287.62 264.73 92.04 55.64 19.35 12.48 4.34 10.41 3.62
142
+ DH_EVAL_0139 39.52 761.06 481.29 63.24 21.03 2.76 213.35 28.03 66.42 8.73
143
+ DH_EVAL_0140 9.36 519.01 481.99 92.87 11.57 2.23 15.83 3.05 21.20 4.08
144
+ DH_EVAL_0141 14.64 611.96 537.79 87.88 15.45 2.52 70.09 11.45 4.07 0.67
145
+ DH_EVAL_0142 9.63 469.91 440.76 93.80 16.08 3.42 16.40 3.49 12.75 2.71
146
+ DH_EVAL_0143 20.38 33.03 28.35 85.81 2.05 6.19 4.69 14.19 0.00 0.00
147
+ DH_EVAL_0144 11.58 324.19 299.87 92.50 13.23 4.08 7.57 2.33 16.75 5.17
148
+ DH_EVAL_0145 26.92 239.68 188.83 78.78 13.67 5.71 40.83 17.04 10.01 4.18
149
+ DH_EVAL_0146 15.39 497.90 450.59 90.50 29.34 5.89 18.95 3.81 28.37 5.70
150
+ DH_EVAL_0147 16.24 278.78 243.21 87.24 9.70 3.48 10.06 3.61 25.51 9.15
151
+ DH_EVAL_0148 12.89 564.73 509.73 90.26 17.81 3.15 33.48 5.93 21.52 3.81
152
+ DH_EVAL_0149 7.62 368.16 356.39 96.80 16.30 4.43 10.16 2.76 1.61 0.44
153
+ DH_EVAL_0150 10.15 499.76 496.02 99.25 46.98 9.40 3.74 0.75 0.00 0.00
154
+ DH_EVAL_0151 4.53 475.17 461.09 97.04 7.43 1.56 14.08 2.96 0.00 0.00
155
+ DH_EVAL_0152 53.50 749.20 426.50 56.93 78.15 10.43 220.96 29.49 101.73 13.58
156
+ DH_EVAL_0153 36.38 155.63 106.77 68.61 7.76 4.98 15.86 10.19 32.99 21.20
157
+ DH_EVAL_0154 22.93 196.22 157.67 80.35 6.45 3.29 29.47 15.02 9.09 4.63
158
+ DH_EVAL_0155 18.84 230.32 198.86 86.34 11.94 5.18 19.14 8.31 12.32 5.35
159
+ DH_EVAL_0156 13.44 105.83 94.69 89.47 3.08 2.91 8.90 8.41 2.25 2.12
160
+ DH_EVAL_0157 16.33 172.68 149.74 86.72 5.25 3.04 15.38 8.90 7.56 4.38
161
+ DH_EVAL_0158 15.01 194.45 169.79 87.32 4.52 2.32 18.45 9.49 6.21 3.19
162
+ DH_EVAL_0159 10.94 491.46 446.26 90.80 8.55 1.74 42.60 8.67 2.60 0.53
163
+ DH_EVAL_0160 49.67 731.94 417.55 57.05 49.16 6.72 219.37 29.97 95.02 12.98
164
+ DH_EVAL_0161 47.00 705.51 417.81 59.22 43.90 6.22 184.40 26.14 103.30 14.64
165
+ DH_EVAL_0162 8.54 638.54 605.06 94.76 21.06 3.30 27.63 4.33 5.85 0.92
166
+ DH_EVAL_0163 20.59 177.17 150.16 84.76 9.47 5.34 21.69 12.24 5.32 3.00
167
+ DH_EVAL_0164 32.79 731.27 505.19 69.08 13.72 1.88 164.68 22.52 61.40 8.40
168
+ DH_EVAL_0165 8.60 122.42 120.62 98.53 8.72 7.12 1.80 1.47 0.00 0.00
169
+ DH_EVAL_0166 47.43 424.52 226.20 53.28 3.02 0.71 144.24 33.98 54.08 12.74
170
+ DH_EVAL_0167 23.26 205.49 167.20 81.36 9.49 4.62 15.56 7.57 22.74 11.06
171
+ DH_EVAL_0168 11.81 596.56 548.64 91.97 22.56 3.78 35.09 5.88 12.82 2.15
172
+ DH_EVAL_0169 9.41 418.61 392.01 93.65 12.78 3.05 23.69 5.66 2.90 0.69
173
+ DH_EVAL_0170 16.46 508.38 436.66 85.89 11.95 2.35 50.46 9.93 21.26 4.18
174
+ DH_EVAL_0171 36.67 604.31 400.24 66.23 17.55 2.90 111.29 18.42 92.78 15.35
175
+ DH_EVAL_0172 15.19 178.97 161.61 90.30 9.83 5.49 4.59 2.57 12.76 7.13
176
+ DH_EVAL_0173 56.22 830.20 410.86 49.49 47.41 5.71 238.45 28.72 180.89 21.79
177
+ DH_EVAL_0174 13.11 479.38 435.19 90.78 18.67 3.89 36.96 7.71 7.24 1.51
178
+ DH_EVAL_0175 12.63 525.46 469.27 89.31 10.15 1.93 11.00 2.09 45.19 8.60
179
+ DH_EVAL_0176 6.57 537.43 512.43 95.35 10.31 1.92 15.44 2.87 9.56 1.78
180
+ DH_EVAL_0177 12.01 237.60 220.35 92.74 11.29 4.75 14.99 6.31 2.26 0.95
181
+ DH_EVAL_0178 84.80 162.67 27.80 17.09 3.07 1.89 65.09 40.01 69.78 42.90
182
+ DH_EVAL_0179 11.47 605.47 562.58 92.92 26.58 4.39 35.58 5.88 7.31 1.21
183
+ DH_EVAL_0180 12.48 301.07 274.38 91.13 10.89 3.62 9.52 3.16 17.17 5.70
184
+ DH_EVAL_0181 28.06 511.65 406.64 79.48 38.54 7.53 78.48 15.34 26.52 5.18
185
+ DH_EVAL_0182 13.63 592.58 540.47 91.21 28.65 4.83 34.04 5.74 18.07 3.05
186
+ DH_EVAL_0183 22.35 270.22 224.09 82.93 14.26 5.28 27.50 10.18 18.63 6.89
187
+ DH_EVAL_0184 18.63 549.14 470.00 85.59 23.16 4.22 52.54 9.57 26.60 4.84
188
+ DH_EVAL_0185 15.48 609.03 538.82 88.47 24.08 3.95 59.24 9.73 10.97 1.80
189
+ DH_EVAL_0186 43.16 548.87 332.77 60.63 20.79 3.79 106.46 19.40 109.64 19.97
190
+ DH_EVAL_0187 7.52 509.80 483.21 94.78 11.75 2.31 9.01 1.77 17.59 3.45
191
+ DH_EVAL_0188 4.69 531.07 516.96 97.34 10.78 2.03 8.19 1.54 5.91 1.11
192
+ DH_EVAL_0189 25.62 154.29 125.59 81.40 10.84 7.02 9.46 6.13 19.24 12.47
193
+ DH_EVAL_0190 22.70 232.43 192.35 82.76 12.69 5.46 20.06 8.63 20.02 8.61
194
+ DH_EVAL_0191 25.00 296.83 257.44 86.73 34.83 11.73 27.55 9.28 11.83 3.99
195
+ DH_EVAL_0192 18.23 225.96 192.11 85.02 7.33 3.24 18.30 8.10 15.55 6.88
196
+ DH_EVAL_0193 7.24 602.41 578.45 96.02 19.64 3.26 22.85 3.79 1.12 0.19
197
+ DH_EVAL_0194 53.44 770.60 407.18 52.84 48.37 6.28 249.66 32.40 113.76 14.76
198
+ DH_EVAL_0195 5.31 447.84 430.92 96.22 6.87 1.53 16.92 3.78 0.00 0.00
199
+ DH_EVAL_0196 8.18 519.28 488.82 94.14 12.01 2.31 15.84 3.05 14.62 2.82
200
+ DH_EVAL_0197 22.67 227.84 186.52 81.87 10.34 4.54 22.86 10.03 18.45 8.10
201
+ DH_EVAL_0198 20.99 599.96 490.03 81.68 16.01 2.67 64.97 10.83 44.96 7.49
202
+ DH_EVAL_0199 62.53 199.17 82.99 41.67 8.35 4.19 47.82 24.01 68.37 34.32
203
+ DH_EVAL_0200 4.29 465.13 453.18 97.43 8.00 1.72 11.95 2.57 0.00 0.00
204
+ DH_EVAL_0201 13.11 535.14 484.98 90.63 19.99 3.73 24.58 4.59 25.58 4.78
205
+ DH_EVAL_0202 4.18 468.81 458.44 97.79 9.20 1.96 10.37 2.21 0.00 0.00
206
+ DH_EVAL_0203 8.66 594.55 563.25 94.74 20.18 3.39 28.44 4.78 2.85 0.48
207
+ DH_EVAL_0204 15.13 211.18 187.45 88.77 8.23 3.90 16.16 7.65 7.57 3.58
208
+ DH_EVAL_0205 18.03 166.38 142.79 85.82 6.41 3.85 10.13 6.09 13.46 8.09
209
+ DH_EVAL_0206 36.41 682.78 466.48 68.32 32.30 4.73 157.15 23.02 59.15 8.66
210
+ DH_EVAL_0207 13.30 229.13 206.78 90.25 8.12 3.55 14.95 6.53 7.39 3.23
211
+ DH_EVAL_0208 34.01 239.26 193.86 81.03 35.97 15.03 16.01 6.69 29.39 12.28
212
+ DH_EVAL_0209 40.50 156.36 110.46 70.64 17.43 11.15 22.06 14.11 23.84 15.25
213
+ DH_EVAL_0210 200.86 31.39 15.56 49.59 47.22 150.45 5.30 16.89 10.52 33.52
214
+ DH_EVAL_0211 12.64 530.28 476.78 89.91 13.51 2.55 37.96 7.16 15.54 2.93
215
+ DH_EVAL_0212 20.41 205.84 171.81 83.47 7.97 3.87 22.87 11.11 11.17 5.43
216
+ DH_EVAL_0213 13.26 599.20 533.07 88.96 13.30 2.22 60.93 10.17 5.20 0.87
217
+ DH_EVAL_0214 38.11 739.59 474.15 64.11 16.45 2.22 195.47 26.43 69.97 9.46
218
+ DH_EVAL_0215 9.36 450.21 417.30 92.69 9.23 2.05 24.09 5.35 8.81 1.96
219
+ DH_EVAL_0216 10.61 225.19 212.70 94.45 11.39 5.06 7.71 3.42 4.78 2.12
220
+ DH_EVAL_0217 11.83 301.29 270.48 89.78 4.85 1.61 27.07 8.99 3.73 1.24
221
+ DH_EVAL_0218 7.68 523.22 496.23 94.84 13.17 2.52 18.97 3.63 8.02 1.53
222
+ DH_EVAL_0219 15.53 447.56 391.49 87.47 13.43 3.00 32.79 7.33 23.29 5.20
223
+ DH_EVAL_0220 14.92 155.02 140.13 90.39 8.23 5.31 12.99 8.38 1.91 1.23
224
+ DH_EVAL_0221 12.41 592.71 538.27 90.82 19.13 3.23 49.61 8.37 4.82 0.81
225
+ DH_EVAL_0222 18.11 200.19 171.22 85.53 7.29 3.64 16.37 8.18 12.60 6.29
226
+ DH_EVAL_0223 28.18 169.70 126.13 74.33 4.24 2.50 17.54 10.34 26.03 15.34
227
+ DH_EVAL_0224 12.20 409.88 377.57 92.12 17.71 4.32 29.01 7.08 3.29 0.80
228
+ DH_EVAL_0225 39.56 43.12 31.64 73.37 5.58 12.94 4.25 9.86 7.23 16.76
229
+ DH_EVAL_0226 24.21 188.03 150.75 80.17 8.24 4.38 21.53 11.45 15.76 8.38
230
+ DH_EVAL_0227 22.03 266.67 216.56 81.21 8.65 3.24 33.69 12.63 16.42 6.16
231
+ DH_EVAL_0228 2.64 508.17 502.25 98.84 7.52 1.48 5.92 1.16 0.00 0.00
232
+ DH_EVAL_0229 18.07 166.63 145.44 87.28 8.92 5.35 17.39 10.44 3.80 2.28
233
+ DH_EVAL_0230 13.29 618.19 557.19 90.13 21.18 3.43 54.38 8.80 6.62 1.07
234
+ DH_EVAL_0231 19.44 261.19 218.05 83.48 7.63 2.92 26.92 10.31 16.22 6.21
235
+ DH_EVAL_0232 23.17 574.66 466.99 81.26 25.46 4.43 54.86 9.55 52.82 9.19
236
+ DH_EVAL_0233 12.61 463.54 446.79 96.39 41.69 8.99 13.04 2.81 3.72 0.80
237
+ DH_EVAL_0234 23.66 578.23 477.25 82.54 35.83 6.20 40.56 7.01 60.42 10.45
238
+ DH_EVAL_0235 21.81 387.37 305.08 78.76 2.18 0.56 72.17 18.63 10.12 2.61
239
+ DH_EVAL_0236 37.06 715.19 481.19 67.28 31.02 4.34 184.45 25.79 49.56 6.93
240
+ DH_EVAL_0237 68.74 37.60 12.32 32.77 0.56 1.50 2.00 5.31 23.28 61.92
241
+ DH_EVAL_0238 63.79 960.48 355.31 36.99 7.54 0.78 428.29 44.59 176.88 18.42
242
+ DH_EVAL_0239 4.09 496.98 490.04 98.60 13.38 2.69 6.13 1.23 0.80 0.16
243
+ DH_EVAL_0240 24.46 107.01 91.31 85.33 10.48 9.79 9.44 8.82 6.26 5.85
244
+ DH_EVAL_0241 9.38 530.54 493.35 92.99 12.60 2.37 28.59 5.39 8.60 1.62
245
+ DH_EVAL_0242 17.32 559.54 481.09 85.98 18.47 3.30 43.93 7.85 34.52 6.17
246
+ DH_EVAL_0243 9.62 350.62 327.95 93.53 11.06 3.15 9.17 2.61 13.51 3.85
247
+ DH_EVAL_0244 12.33 203.14 187.43 92.27 9.35 4.60 7.93 3.90 7.77 3.83
248
+ DH_EVAL_0245 17.21 291.88 252.13 86.38 10.48 3.59 24.54 8.41 15.21 5.21
249
+ DH_EVAL_0246 17.55 538.67 459.89 85.38 15.78 2.93 52.59 9.76 26.19 4.86
250
+ DH_EVAL_0247 11.26 524.59 484.13 92.29 18.60 3.55 33.09 6.31 7.36 1.40
251
+ DH_EVAL_0248 12.77 636.58 576.89 90.62 21.60 3.39 46.75 7.34 12.95 2.03
252
+ DH_EVAL_0249 17.74 618.25 520.57 84.20 11.99 1.94 94.70 15.32 2.98 0.48
253
+ DH_EVAL_0250 17.21 590.11 507.17 85.94 18.62 3.16 71.77 12.16 11.17 1.89
254
+ DH_EVAL_0251 18.14 218.83 185.99 84.99 6.86 3.13 23.62 10.79 9.22 4.21
255
+ DH_EVAL_0252 24.89 124.22 99.74 80.29 6.43 5.18 6.14 4.94 18.34 14.77
256
+ DH_EVAL_0253 7.01 492.02 471.29 95.79 13.75 2.79 13.54 2.75 7.19 1.46
257
+ DH_EVAL_0254 58.82 610.19 316.52 51.87 65.22 10.69 188.54 30.90 105.14 17.23
258
+ DH_EVAL_0255 11.10 635.93 587.77 92.43 22.43 3.53 44.71 7.03 3.44 0.54
259
+ DH_EVAL_0256 24.22 187.90 155.63 82.83 13.24 7.04 19.11 10.17 13.16 7.00
260
+ DH_EVAL_0257 10.82 530.20 491.63 92.73 18.78 3.54 15.90 3.00 22.67 4.27
261
+ DH_EVAL_0258 18.12 162.26 138.27 85.22 5.41 3.34 14.27 8.79 9.72 5.99
262
+ DH_EVAL_0259 53.96 93.87 45.75 48.74 2.54 2.70 34.61 36.87 13.51 14.39
263
+ TOTAL 20.99 103757.36 86389.78 83.26 4405.91 4.25 11144.06 10.74 6223.52 6.00
reproducible_research/2022.07/DIHARD.SpeakerDiarization.Full.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.eval ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ BFMTV_BFMStory_2012-07-24_175800 20.71 3373.81 2723.50 80.72 48.43 1.44 141.42 4.19 508.90 15.08
5
+ BFMTV_BFMStory_2012-07-26_175800 17.44 2931.58 2445.40 83.42 25.05 0.85 74.30 2.53 411.88 14.05
6
+ BFMTV_BFMStory_2012-07-27_175800 17.79 2721.21 2272.39 83.51 35.40 1.30 83.35 3.06 365.47 13.43
7
+ BFMTV_BFMStory_2012-08-24_175800 18.15 2817.69 2326.05 82.55 19.82 0.70 91.29 3.24 400.35 14.21
8
+ BFMTV_BFMStory_2012-11-09_175800 3.76 954.20 920.86 96.51 2.51 0.26 22.64 2.37 10.70 1.12
9
+ BFMTV_BFMStory_2012-11-14_175800 10.65 976.95 876.06 89.67 3.13 0.32 52.34 5.36 48.54 4.97
10
+ BFMTV_BFMStory_2012-11-15_175800 3.34 895.79 872.09 97.35 6.20 0.69 16.04 1.79 7.66 0.86
11
+ BFMTV_CultureEtVous_2012-02-20_065040 15.42 120.17 102.49 85.29 0.85 0.70 15.54 12.93 2.14 1.78
12
+ BFMTV_CultureEtVous_2012-02-24_065040 22.13 250.92 204.88 81.65 9.49 3.78 26.78 10.67 19.27 7.68
13
+ BFMTV_CultureEtVous_2012-04-05_065040 16.13 110.28 95.90 86.96 3.41 3.10 10.37 9.40 4.01 3.64
14
+ BFMTV_CultureEtVous_2012-05-14_065040 17.63 101.81 87.24 85.69 3.38 3.32 9.40 9.24 5.17 5.07
15
+ BFMTV_CultureEtVous_2012-07-18_065040 21.99 97.30 81.60 83.87 5.70 5.86 6.88 7.07 8.82 9.06
16
+ BFMTV_CultureEtVous_2012-07-23_065040 15.13 94.13 85.46 90.79 5.57 5.92 8.09 8.59 0.58 0.62
17
+ BFMTV_CultureEtVous_2012-10-05_064700 9.15 99.40 90.86 91.41 0.55 0.55 0.31 0.31 8.24 8.29
18
+ BFMTV_CultureEtVous_2012-10-08_064700 24.88 86.06 76.02 88.34 11.37 13.21 5.73 6.66 4.31 5.01
19
+ BFMTV_CultureEtVous_2012-10-09_064700 16.97 92.33 83.84 90.81 7.18 7.78 1.86 2.01 6.63 7.18
20
+ BFMTV_CultureEtVous_2012-10-12_064700 22.66 125.20 98.17 78.41 1.34 1.07 11.52 9.20 15.51 12.39
21
+ BFMTV_CultureEtVous_2012-10-16_064700 38.38 123.41 79.33 64.28 3.29 2.66 13.84 11.21 30.24 24.50
22
+ BFMTV_CultureEtVous_2012-10-17_064700 20.89 91.76 78.53 85.58 5.94 6.47 4.56 4.97 8.67 9.45
23
+ BFMTV_CultureEtVous_2012-10-18_064700 7.09 94.62 90.38 95.52 2.46 2.60 0.68 0.72 3.57 3.77
24
+ BFMTV_CultureEtVous_2012-10-22_064700 23.56 118.20 92.73 78.45 2.37 2.01 20.07 16.98 5.40 4.57
25
+ BFMTV_CultureEtVous_2012-10-23_064700 19.23 84.44 74.85 88.64 6.64 7.87 0.05 0.05 9.54 11.30
26
+ BFMTV_CultureEtVous_2012-10-24_064700 23.04 111.54 86.93 77.93 1.08 0.97 9.55 8.57 15.06 13.50
27
+ BFMTV_CultureEtVous_2012-10-26_064700 27.49 98.27 72.66 73.94 1.41 1.44 11.75 11.96 13.85 14.10
28
+ BFMTV_CultureEtVous_2012-11-09_064700 17.60 112.10 94.09 83.93 1.71 1.53 8.90 7.94 9.11 8.13
29
+ BFMTV_CultureEtVous_2012-12-10_064700 14.66 89.69 83.42 93.01 6.88 7.67 0.96 1.07 5.30 5.91
30
+ BFMTV_CultureEtVous_2012-12-11_064700 21.13 98.45 83.15 84.46 5.51 5.59 2.35 2.39 12.95 13.15
31
+ BFMTV_CultureEtVous_2012-12-12_065040 20.32 109.94 88.09 80.12 0.48 0.44 11.47 10.44 10.38 9.44
32
+ BFMTV_CultureEtVous_2012-12-13_064700 26.31 98.62 76.64 77.72 3.98 4.03 11.70 11.87 10.27 10.41
33
+ BFMTV_CultureEtVous_2012-12-17_064700 19.00 120.19 109.55 91.14 12.19 10.14 3.59 2.99 7.05 5.87
34
+ BFMTV_CultureEtVous_2012-12-21_064700 10.99 107.58 97.64 90.76 1.89 1.76 8.78 8.16 1.16 1.08
35
+ BFMTV_CultureEtVous_2013-01-03_064700 3.61 98.49 95.93 97.40 0.99 1.01 0.76 0.78 1.80 1.82
36
+ BFMTV_RuthElkrief_2012-09-18_190340 15.16 316.64 272.34 86.01 3.71 1.17 28.32 8.95 15.98 5.05
37
+ BFMTV_RuthElkrief_2012-09-19_190040 2.84 284.33 277.70 97.67 1.45 0.51 5.48 1.93 1.15 0.41
38
+ BFMTV_RuthElkrief_2012-09-20_190040 38.94 374.71 229.29 61.19 0.50 0.13 10.24 2.73 135.18 36.08
39
+ BFMTV_RuthElkrief_2012-09-21_190040 6.96 299.02 282.81 94.58 4.61 1.54 9.12 3.05 7.08 2.37
40
+ LCP_CaVousRegarde_2012-09-19_002500 10.76 288.42 259.37 89.93 1.98 0.69 3.06 1.06 25.99 9.01
41
+ LCP_CaVousRegarde_2012-09-20_002500 16.58 367.72 314.73 85.59 7.99 2.17 16.35 4.45 36.64 9.96
42
+ LCP_CaVousRegarde_2012-09-25_202500 8.48 331.51 309.05 93.23 5.65 1.70 7.76 2.34 14.69 4.43
43
+ LCP_EntreLesLignes_2012-10-19_212000 7.37 1694.95 1606.36 94.77 36.37 2.15 28.48 1.68 60.11 3.55
44
+ LCP_EntreLesLignes_2012-12-08_032500 19.19 335.68 273.98 81.62 2.70 0.80 11.01 3.28 50.70 15.10
45
+ LCP_EntreLesLignes_2013-01-19_212400 6.45 327.27 309.20 94.48 3.02 0.92 7.39 2.26 10.69 3.27
46
+ LCP_EntreLesLignes_2013-03-02_212400 21.19 364.59 291.16 79.86 3.82 1.05 14.46 3.96 58.97 16.17
47
+ LCP_EntreLesLignes_2013-03-16_212400 5.60 1013.49 987.97 97.48 31.28 3.09 10.38 1.02 15.14 1.49
48
+ LCP_LCPActu14h_2012-11-26_135500 3.60 580.20 559.60 96.45 0.28 0.05 14.44 2.49 6.16 1.06
49
+ LCP_LCPActu14h_2013-01-08_135400 7.13 588.88 553.79 94.04 6.87 1.17 13.65 2.32 21.44 3.64
50
+ LCP_LCPActu14h_2013-01-09_135400 3.36 602.77 584.41 96.95 1.91 0.32 5.35 0.89 13.01 2.16
51
+ LCP_LCPInfo13h30_2012-04-11_132700 6.75 889.32 856.53 96.31 27.25 3.06 26.80 3.01 5.98 0.67
52
+ LCP_LCPInfo13h30_2012-04-12_132700 8.66 911.62 851.31 93.38 18.68 2.05 13.19 1.45 47.12 5.17
53
+ LCP_LCPInfo13h30_2012-04-13_132700 11.55 837.16 752.26 89.86 11.81 1.41 23.80 2.84 61.10 7.30
54
+ LCP_LCPInfo13h30_2012-04-19_132700 13.32 861.63 752.03 87.28 5.13 0.60 49.49 5.74 60.11 6.98
55
+ LCP_LCPInfo13h30_2012-05-03_132700 10.76 962.86 875.78 90.96 16.48 1.71 39.37 4.09 47.71 4.96
56
+ LCP_PileEtFace_2012-07-05_192700 6.55 904.26 864.43 95.60 19.35 2.14 11.39 1.26 28.44 3.15
57
+ LCP_PileEtFace_2012-10-04_192200 6.32 1731.16 1663.03 96.06 41.27 2.38 29.62 1.71 38.50 2.22
58
+ LCP_PileEtFace_2012-10-15_142500 7.53 1584.62 1509.04 95.23 43.76 2.76 65.93 4.16 9.66 0.61
59
+ LCP_PileEtFace_2012-10-26_012500 3.32 186.30 180.23 96.74 0.11 0.06 5.44 2.92 0.62 0.34
60
+ LCP_PileEtFace_2012-11-30_012500 12.75 184.46 163.21 88.48 2.27 1.23 6.08 3.30 15.17 8.22
61
+ LCP_PileEtFace_2012-12-08_012500 15.42 192.02 165.20 86.03 2.78 1.45 2.34 1.22 24.48 12.75
62
+ LCP_TopQuestions_2012-11-28_232500 3.57 724.12 706.57 97.58 8.32 1.15 13.60 1.88 3.95 0.55
63
+ LCP_TopQuestions_2013-01-30_232600 5.71 584.85 552.16 94.41 0.68 0.12 26.25 4.49 6.44 1.10
64
+ LCP_TopQuestions_2013-04-24_232600 4.81 342.38 329.84 96.34 3.92 1.15 6.28 1.83 6.27 1.83
65
+ TOTAL 12.62 36073.06 32080.10 88.93 560.20 1.55 1191.94 3.30 2801.01 7.76
reproducible_research/2022.07/REPERE.SpeakerDiarization.Full.test.rttm ADDED
The diff for this file is too large to render. See raw diff
 
reproducible_research/2022.07/VoxConverse.SpeakerDiarization.VoxConverse.test.eval ADDED
@@ -0,0 +1,236 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ diarization error rate total correct correct false alarm false alarm missed detection missed detection confusion confusion
2
+ % % % % %
3
+ item
4
+ aepyx 8.85 148.29 142.45 96.06 7.28 4.91 5.15 3.47 0.69 0.47
5
+ aggyz 7.28 249.56 237.96 95.35 6.58 2.64 3.28 1.32 8.31 3.33
6
+ aiqwk 38.39 177.68 122.29 68.82 12.81 7.21 3.01 1.69 52.38 29.48
7
+ aorju 19.20 1071.67 894.15 83.44 28.20 2.63 19.40 1.81 158.12 14.75
8
+ auzru 2.60 508.70 502.59 98.80 7.10 1.40 3.86 0.76 2.25 0.44
9
+ bgvvt 10.33 1004.29 948.27 94.42 47.72 4.75 53.32 5.31 2.70 0.27
10
+ bidnq 21.20 1135.54 939.41 82.73 44.59 3.93 97.62 8.60 98.51 8.68
11
+ bjruf 17.56 372.33 322.59 86.64 15.64 4.20 41.73 11.21 8.01 2.15
12
+ bmsyn 36.04 602.19 456.96 75.88 71.80 11.92 76.07 12.63 69.16 11.48
13
+ bpzsc 7.62 1039.34 976.42 93.95 16.29 1.57 33.75 3.25 29.17 2.81
14
+ bvqnu 8.44 554.47 522.86 94.30 15.19 2.74 11.66 2.10 19.96 3.60
15
+ bvyvm 9.29 105.16 98.10 93.29 2.71 2.58 5.71 5.43 1.35 1.28
16
+ bxcfq 3.62 201.38 194.64 96.65 0.55 0.27 5.00 2.48 1.74 0.86
17