Update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,23 @@ language:
|
|
7 |
---
|
8 |
# Whisper Large RixVox Swedish
|
9 |
|
10 |
-
This is a Whisper-large finetuned for Swedish using the RixVox dataset.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
---
|
8 |
# Whisper Large RixVox Swedish
|
9 |
|
10 |
+
This is a [Whisper large](https://huggingface.co/openai/whisper-large-v2) finetuned for Swedish using the [RixVox](https://huggingface.co/datasets/KBLab/rixvox) dataset.
|
11 |
+
|
12 |
+
## Evaluation using [Common Voice 11](#):
|
13 |
+
|
14 |
+
* WER: XYZ
|
15 |
+
* WER (normalized): XYZ
|
16 |
+
|
17 |
+
## Training
|
18 |
+
|
19 |
+
Training was done using Huggingface and Deepspeed with ZeRO stage 2.
|
20 |
+
|
21 |
+
* learning rate: 1e-5
|
22 |
+
* optimizer: CPUAdamW (deepspeed)
|
23 |
+
* lr scheduler: linear
|
24 |
+
* warmup steps: 500
|
25 |
+
* per device batch size: 20
|
26 |
+
* GPUs: 8 x NVIDIA A100 40GB
|
27 |
+
* total batch size: 160
|
28 |
+
* steps: 20000
|
29 |
+
* entire decoder was frozen
|