readerbench
/

RoBERT-small

Inference Endpoints

Model card Files Files and versions Community

Mihai-Dan MAŞALA (25095) commited on Dec 4, 2020

Commit

23a9a61

•

1 Parent(s): c212f7b

Update README

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -11,12 +11,12 @@ language:
 ## Pretrained BERT model for Romanian
 Pretrained model on Romanian language using a masked language modeling (MLM) and next sentence prediction (NSP) objective.
-It was introduced in this [paper](https://www.blank.org/). Three BERT models were released: RoBERT-small, RoBERT-base and RoBERT-large, all versions uncased.
 | Model        | Weights   |   L    |   H    |    A   | MLM accuracy | NSP accuracy |
 |--------------|:---------:|:------:|:------:|:------:|:------------:|:------------:|
-| RoBERT-small | 19M       | 12     | 256    | 8      | 0.5363       | 0.9687       |
-| \textit{RoBERT-base}  | 114M      | 12     | 768    | 12     | 0.6511       | 0.9802       |
 | RoBERT-large | 341M      | 24     | 1024   | 24     | 0.6929       | 0.9843       |

 ## Pretrained BERT model for Romanian
 Pretrained model on Romanian language using a masked language modeling (MLM) and next sentence prediction (NSP) objective.
+It was introduced in this [paper](https://www.blank.org/). Three BERT models were released: **RoBERT-small**, RoBERT-base and RoBERT-large, all versions uncased.
 | Model        | Weights   |   L    |   H    |    A   | MLM accuracy | NSP accuracy |
 |--------------|:---------:|:------:|:------:|:------:|:------------:|:------------:|
+| *RoBERT-small* | *19M*       | *12*     | *256*    | *8*      | *0.5363*       | *0.9687*       |
+| RoBERT-base  | 114M      | 12     | 768    | 12     | 0.6511       | 0.9802       |
 | RoBERT-large | 341M      | 24     | 1024   | 24     | 0.6929       | 0.9843       |