Graphcore
Dongsung commited on
Commit
1f874ab
1 Parent(s): 7a09af6

Update model descriptions

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -6,6 +6,12 @@ This model contains just the `IPUConfig` files for running the HuBERT-base model
6
 
7
  **This model contains no model weights, only an IPUConfig.**
8
 
 
 
 
 
 
 
9
  ## Usage
10
 
11
  ```
 
6
 
7
  **This model contains no model weights, only an IPUConfig.**
8
 
9
+ ## Model description
10
+ HUBERT (Hidden-Unit BERT) is a BERT-based model for self-supervised speech representation learning approach that relies on predicting K-means cluster assignments of masked segments of continuous output. This approach forces the model to learn a combined acoustic and language model over the continuous inputs by applying the prediction loss over the masked region.
11
+
12
+ Paper link : [Self-Supervised Speech Representation
13
+ Learning by Masked Prediction of Hidden Unit](https://arxiv.org/pdf/2106.07447v1.pdf)
14
+
15
  ## Usage
16
 
17
  ```