Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,7 @@ This model replicates the "DistilBERT (D)" model from Table 2 of the [DistilBERT
|
|
19 |
In this version, the following pre-trained models were used:
|
20 |
|
21 |
* Student: `distilbert-base-uncased`
|
22 |
-
* Teacher: `
|
23 |
|
24 |
## Training data
|
25 |
|
@@ -32,15 +32,14 @@ squad = load_dataset('squad')
|
|
32 |
|
33 |
## Training procedure
|
34 |
|
35 |
-
|
36 |
## Eval results
|
37 |
|
38 |
-
Exact Match
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
|
43 |
-
The
|
44 |
|
45 |
### BibTeX entry and citation info
|
46 |
|
|
|
19 |
In this version, the following pre-trained models were used:
|
20 |
|
21 |
* Student: `distilbert-base-uncased`
|
22 |
+
* Teacher: `lewtun/bert-base-uncased-finetuned-squad-v1`
|
23 |
|
24 |
## Training data
|
25 |
|
|
|
32 |
|
33 |
## Training procedure
|
34 |
|
|
|
35 |
## Eval results
|
36 |
|
37 |
+
| | Exact Match | F1 |
|
38 |
+
|------------------|-------------|------|
|
39 |
+
| DistilBERT paper | 79.1 | 86.9 |
|
40 |
+
| Ours | 78.4 | 86.5 |
|
41 |
|
42 |
+
The scores were calculated using the `squad` metric from `datasets`.
|
43 |
|
44 |
### BibTeX entry and citation info
|
45 |
|