Update model descriptions
Browse files
README.md
CHANGED
@@ -6,6 +6,12 @@ This model contains just the `IPUConfig` files for running the HuBERT-base model
|
|
6 |
|
7 |
**This model contains no model weights, only an IPUConfig.**
|
8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
## Usage
|
10 |
|
11 |
```
|
|
|
6 |
|
7 |
**This model contains no model weights, only an IPUConfig.**
|
8 |
|
9 |
+
## Model description
|
10 |
+
HUBERT (Hidden-Unit BERT) is a BERT-based model for self-supervised speech representation learning approach that relies on predicting K-means cluster assignments of masked segments of continuous output. This approach forces the model to learn a combined acoustic and language model over the continuous inputs by applying the prediction loss over the masked region.
|
11 |
+
|
12 |
+
Paper link : [Self-Supervised Speech Representation
|
13 |
+
Learning by Masked Prediction of Hidden Unit](https://arxiv.org/pdf/2106.07447v1.pdf)
|
14 |
+
|
15 |
## Usage
|
16 |
|
17 |
```
|