patrickvonplaten commited on
Commit
418d5bf
1 Parent(s): 9585ebc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -5
README.md CHANGED
@@ -14,16 +14,20 @@ license: apache-2.0
14
 
15
  # Wav2Vec2-XLS-R-300M-21-EN
16
 
17
- Facebook's Wav2Vec2 XLS-R fine-tuned for Speech Translation.
18
 
19
  ![model image](https://raw.githubusercontent.com/patrickvonplaten/scientific_images/master/xls_r.png)
20
 
21
  This is a [SpeechEncoderDecoderModel](https://huggingface.co/transformers/model_doc/speechencoderdecoder.html) model.
22
- The encoder was warm-started from the [`facebook/wav2vec2-xls-r-300m`](https://huggingface.co/facebook/wav2vec2-xls-r-300m) checkpoint and
23
- the decoder was warm-started from the [`facebook/mbart-large-50`](https://huggingface.co/facebook/mbart-large-50) checkpoint.
24
- Consequently, the encoder-decoder model was fine-tuned on 21 {lang}-to-English translation pairs of the [Covost2 dataset](https://huggingface.co/datasets/covost2).
25
 
26
- For more information, please refer to Section *5.1.2* of the [official XLS-R paper]( ).
 
 
 
 
27
 
28
  ## Usage
29
 
14
 
15
  # Wav2Vec2-XLS-R-300M-21-EN
16
 
17
+ Facebook's Wav2Vec2 XLS-R fine-tuned for **Speech Translation.**
18
 
19
  ![model image](https://raw.githubusercontent.com/patrickvonplaten/scientific_images/master/xls_r.png)
20
 
21
  This is a [SpeechEncoderDecoderModel](https://huggingface.co/transformers/model_doc/speechencoderdecoder.html) model.
22
+ The encoder was warm-started from the [**`facebook/wav2vec2-xls-r-300m`**](https://huggingface.co/facebook/wav2vec2-xls-r-300m) checkpoint and
23
+ the decoder from the [**`facebook/mbart-large-50`**](https://huggingface.co/facebook/mbart-large-50) checkpoint.
24
+ Consequently, the encoder-decoder model was fine-tuned on 21 `{lang}`-to-English translation pairs of the [Covost2 dataset](https://huggingface.co/datasets/covost2).
25
 
26
+ The model can translate from the following spoken languages (`{lang}`) to English:
27
+
28
+
29
+
30
+ For more information, please refer to Section *5.1.2* of the [official XLS-R paper](https://arxiv.org/abs/2111.09296).
31
 
32
  ## Usage
33