lewtun HF staff commited on
Commit
8ca959b
1 Parent(s): fcf3ada

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -14,7 +14,9 @@ metrics:
14
 
15
  ## Model description
16
 
17
- This model replicates the "DistilBERT (D)" model from Table 2 of the [DistilBERT paper](https://arxiv.org/pdf/1910.01108.pdf). In this approach, a DistilBERT student is fine-tuned on SQuAD v1.1, while a fine-tuned BERT model acts as a teacher for a second step of task-specific distillation.In this version, the following pre-trained models were used:
 
 
18
 
19
  * Student: `distilbert-base-uncased`
20
  * Teacher: `maroo93/squad1.1`## Intended uses & limitations
 
14
 
15
  ## Model description
16
 
17
+ This model replicates the "DistilBERT (D)" model from Table 2 of the [DistilBERT paper](https://arxiv.org/pdf/1910.01108.pdf). In this approach, a DistilBERT student is fine-tuned on SQuAD v1.1, while a fine-tuned BERT model acts as a teacher for a second step of task-specific distillation.
18
+
19
+ In this version, the following pre-trained models were used:
20
 
21
  * Student: `distilbert-base-uncased`
22
  * Teacher: `maroo93/squad1.1`## Intended uses & limitations