patrickvonplaten
commited on
Commit
•
418d5bf
1
Parent(s):
9585ebc
Update README.md
Browse files
README.md
CHANGED
@@ -14,16 +14,20 @@ license: apache-2.0
|
|
14 |
|
15 |
# Wav2Vec2-XLS-R-300M-21-EN
|
16 |
|
17 |
-
Facebook's Wav2Vec2 XLS-R fine-tuned for Speech Translation
|
18 |
|
19 |
![model image](https://raw.githubusercontent.com/patrickvonplaten/scientific_images/master/xls_r.png)
|
20 |
|
21 |
This is a [SpeechEncoderDecoderModel](https://huggingface.co/transformers/model_doc/speechencoderdecoder.html) model.
|
22 |
-
The encoder was warm-started from the [
|
23 |
-
the decoder
|
24 |
-
Consequently, the encoder-decoder model was fine-tuned on 21 {lang}
|
25 |
|
26 |
-
|
|
|
|
|
|
|
|
|
27 |
|
28 |
## Usage
|
29 |
|
14 |
|
15 |
# Wav2Vec2-XLS-R-300M-21-EN
|
16 |
|
17 |
+
Facebook's Wav2Vec2 XLS-R fine-tuned for **Speech Translation.**
|
18 |
|
19 |
![model image](https://raw.githubusercontent.com/patrickvonplaten/scientific_images/master/xls_r.png)
|
20 |
|
21 |
This is a [SpeechEncoderDecoderModel](https://huggingface.co/transformers/model_doc/speechencoderdecoder.html) model.
|
22 |
+
The encoder was warm-started from the [**`facebook/wav2vec2-xls-r-300m`**](https://huggingface.co/facebook/wav2vec2-xls-r-300m) checkpoint and
|
23 |
+
the decoder from the [**`facebook/mbart-large-50`**](https://huggingface.co/facebook/mbart-large-50) checkpoint.
|
24 |
+
Consequently, the encoder-decoder model was fine-tuned on 21 `{lang}`-to-English translation pairs of the [Covost2 dataset](https://huggingface.co/datasets/covost2).
|
25 |
|
26 |
+
The model can translate from the following spoken languages (`{lang}`) to English:
|
27 |
+
|
28 |
+
|
29 |
+
|
30 |
+
For more information, please refer to Section *5.1.2* of the [official XLS-R paper](https://arxiv.org/abs/2111.09296).
|
31 |
|
32 |
## Usage
|
33 |
|