Update README.md
Browse files
README.md
CHANGED
@@ -29,13 +29,13 @@ You can download the 24 Chinese RoBERTa miniatures either from the [UER-py Model
|
|
29 |
|
30 |
Here are scores on the devlopment set of six Chinese tasks:
|
31 |
|
32 |
-
| Model | Score |
|
33 |
| -------------- | :---: | :----: | :----------: | :---: | :---------: | :-----------: | :---------: |
|
34 |
-
| RoBERTa-Tiny | 72.3 | 83.
|
35 |
-
| RoBERTa-Mini | 75.
|
36 |
-
| RoBERTa-Small | 76.
|
37 |
-
| RoBERTa-Medium |
|
38 |
-
| RoBERTa-Base | 79.
|
39 |
|
40 |
For each task, we selected the best fine-tuning hyperparameters from the lists below, and trained with the sequence length of 128:
|
41 |
|
|
|
29 |
|
30 |
Here are scores on the devlopment set of six Chinese tasks:
|
31 |
|
32 |
+
| Model | Score | book_review | chnsenticorp | lcqmc | tnews(CLUE) | iflytek(CLUE) | ocnli(CLUE) |
|
33 |
| -------------- | :---: | :----: | :----------: | :---: | :---------: | :-----------: | :---------: |
|
34 |
+
| RoBERTa-Tiny | 72.3 | 83.4 | 91.4 | 81.8 | 62.0 | 55.0 | 60.3 |
|
35 |
+
| RoBERTa-Mini | 75.9 | 85.7 | 93.7 | 86.1 | 63.9 | 58.3 | 67.4 |
|
36 |
+
| RoBERTa-Small | 76.9 | 87.5 | 93.4 | 86.5 | 65.1 | 59.4 | 69.7 |
|
37 |
+
| RoBERTa-Medium | 78.0 | 88.7 | 94.8 | 88.1 | 65.6 | 59.5 | 71.2 |
|
38 |
+
| RoBERTa-Base | 79.7 | 90.1 | 95.2 | 89.2 | 67.0 | 60.9 | 75.5 |
|
39 |
|
40 |
For each task, we selected the best fine-tuning hyperparameters from the lists below, and trained with the sequence length of 128:
|
41 |
|