matejulcar
commited on
Commit
•
7d95fb6
1
Parent(s):
7088f81
updated with v2 model
Browse files- README.md +4 -0
- config.json +1 -1
- pytorch_model.bin +1 -1
README.md
CHANGED
@@ -7,6 +7,7 @@ license: cc-by-sa-4.0
|
|
7 |
|
8 |
# t5-sl-small
|
9 |
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
|
|
|
10 |
|
11 |
## Corpora
|
12 |
The following corpora were used for training the model:
|
@@ -15,3 +16,6 @@ The following corpora were used for training the model:
|
|
15 |
* Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
|
16 |
* Slovenian parliamentary corpus siParl 2.0
|
17 |
* slWaC
|
|
|
|
|
|
|
|
7 |
|
8 |
# t5-sl-small
|
9 |
t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
|
10 |
+
It was trained for 5 epochs on the following corpora:
|
11 |
|
12 |
## Corpora
|
13 |
The following corpora were used for training the model:
|
|
|
16 |
* Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
|
17 |
* Slovenian parliamentary corpus siParl 2.0
|
18 |
* slWaC
|
19 |
+
|
20 |
+
## Changelog
|
21 |
+
2022-07-21: updated with v2 of the model, the old one is still accesible at [cjvt/legacy-t5-sl-small](https://huggingface.co/cjvt/legacy-t5-sl-small).
|
config.json
CHANGED
@@ -22,7 +22,7 @@
|
|
22 |
"relative_attention_num_buckets": 32,
|
23 |
"tie_word_embeddings": false,
|
24 |
"torch_dtype": "float32",
|
25 |
-
"transformers_version": "4.
|
26 |
"use_cache": true,
|
27 |
"vocab_size": 32000
|
28 |
}
|
|
|
22 |
"relative_attention_num_buckets": 32,
|
23 |
"tie_word_embeddings": false,
|
24 |
"torch_dtype": "float32",
|
25 |
+
"transformers_version": "4.9.1",
|
26 |
"use_cache": true,
|
27 |
"vocab_size": 32000
|
28 |
}
|
pytorch_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 307402757
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:891fa1f9de9d243383fe075f4e8a044b3147a842d21d05f4e7a91db19eb820c0
|
3 |
size 307402757
|