Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,8 @@ tags:
|
|
11 |
SinBerto is a small language model trained on a small news corpus. SinBerto is trained on Sinhala Language which is a low resource language compared to other languages.
|
12 |
|
13 |
### Model Specifications.
|
14 |
-
model : [Roberta](https://arxiv.org/abs/1907.11692)
|
|
|
15 |
vocab_size=52_000,
|
16 |
max_position_embeddings=514,
|
17 |
num_attention_heads=12,
|
|
|
11 |
SinBerto is a small language model trained on a small news corpus. SinBerto is trained on Sinhala Language which is a low resource language compared to other languages.
|
12 |
|
13 |
### Model Specifications.
|
14 |
+
model : [Roberta](https://arxiv.org/abs/1907.11692)
|
15 |
+
|
16 |
vocab_size=52_000,
|
17 |
max_position_embeddings=514,
|
18 |
num_attention_heads=12,
|