Update README.md
Browse files
README.md
CHANGED
@@ -6,7 +6,7 @@ language:
|
|
6 |
pipeline_tag: text-generation
|
7 |
---
|
8 |
|
9 |
-
# Model Card for
|
10 |
|
11 |
This is the 1B OPT model additionally pretrained on Slovene data. The model was created as a part of project Povejmo: https://www.cjvt.si/povejmo/.
|
12 |
|
@@ -29,7 +29,7 @@ The model was additionally pretrained on the following Slovene, English, and Cro
|
|
29 |
| Wikipedia | English | 4.7 B | 9.9 % |
|
30 |
| CC-News | English | 0.4 B | 0.83 % |
|
31 |
|
32 |
-
The total size of additional training data is **
|
33 |
|
34 |
## Model usage
|
35 |
|
@@ -38,7 +38,7 @@ The inference can be done using the following snippet of code:
|
|
38 |
```python
|
39 |
import transformers
|
40 |
|
41 |
-
model_id = ("cjvt/
|
42 |
|
43 |
pipeline = transformers.pipeline(
|
44 |
"text-generation",
|
|
|
6 |
pipeline_tag: text-generation
|
7 |
---
|
8 |
|
9 |
+
# Model Card for OPT_GaMS-1B-Chat
|
10 |
|
11 |
This is the 1B OPT model additionally pretrained on Slovene data. The model was created as a part of project Povejmo: https://www.cjvt.si/povejmo/.
|
12 |
|
|
|
29 |
| Wikipedia | English | 4.7 B | 9.9 % |
|
30 |
| CC-News | English | 0.4 B | 0.83 % |
|
31 |
|
32 |
+
The total size of additional training data is **28.13 B** tokens.
|
33 |
|
34 |
## Model usage
|
35 |
|
|
|
38 |
```python
|
39 |
import transformers
|
40 |
|
41 |
+
model_id = ("cjvt/OPT_GaMS-1B-chat")
|
42 |
|
43 |
pipeline = transformers.pipeline(
|
44 |
"text-generation",
|