Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ metrics:
|
|
| 26 |
- perplexity
|
| 27 |
---
|
| 28 |
|
| 29 |
-
**bertina-3M** is an italian foundational model based on bert, pretrained from scratch on 30GB of italian Wikipedia articles (10M sentences).
|
| 30 |
|
| 31 |
It has 3M parameters and uses a 512 context window size.
|
| 32 |
|
|
|
|
| 26 |
- perplexity
|
| 27 |
---
|
| 28 |
|
| 29 |
+
**bertina-3M** is an italian foundational model based on bert, pretrained from scratch on 30GB of italian Wikipedia articles (10M sentences, 329M tokens).
|
| 30 |
|
| 31 |
It has 3M parameters and uses a 512 context window size.
|
| 32 |
|