readerbench
/

RoBERT-small

Inference Endpoints

Model card Files Files and versions Community

Mihai-Dan MAŞALA (25095) commited on Dec 4, 2020

Commit

c212f7b

•

1 Parent(s): b460ae6

Update README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ It was introduced in this [paper](https://www.blank.org/). Three BERT models wer
 | Model        | Weights   |   L    |   H    |    A   | MLM accuracy | NSP accuracy |
 |--------------|:---------:|:------:|:------:|:------:|:------------:|:------------:|
 | RoBERT-small | 19M       | 12     | 256    | 8      | 0.5363       | 0.9687       |
-| RoBERT-base  | 114M      | 12     | 768    | 12     | 0.6511       | 0.9802       |
 | RoBERT-large | 341M      | 24     | 1024   | 24     | 0.6929       | 0.9843       |

 | Model        | Weights   |   L    |   H    |    A   | MLM accuracy | NSP accuracy |
 |--------------|:---------:|:------:|:------:|:------:|:------------:|:------------:|
 | RoBERT-small | 19M       | 12     | 256    | 8      | 0.5363       | 0.9687       |
+| \textit{RoBERT-base}  | 114M      | 12     | 768    | 12     | 0.6511       | 0.9802       |
 | RoBERT-large | 341M      | 24     | 1024   | 24     | 0.6929       | 0.9843       |