cjvt
/

matejulcar commited on
Commit
7d95fb6
1 Parent(s): 7088f81

updated with v2 model

Browse files
Files changed (3) hide show
  1. README.md +4 -0
  2. config.json +1 -1
  3. pytorch_model.bin +1 -1
README.md CHANGED
@@ -7,6 +7,7 @@ license: cc-by-sa-4.0
7
 
8
  # t5-sl-small
9
  t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
 
10
 
11
  ## Corpora
12
  The following corpora were used for training the model:
@@ -15,3 +16,6 @@ The following corpora were used for training the model:
15
  * Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
16
  * Slovenian parliamentary corpus siParl 2.0
17
  * slWaC
 
 
 
 
7
 
8
  # t5-sl-small
9
  t5-sl-small model is a Slovene T5 model. It has 8 encoder and 8 decoder layers, in total about 60 million parameters.
10
+ It was trained for 5 epochs on the following corpora:
11
 
12
  ## Corpora
13
  The following corpora were used for training the model:
 
16
  * Janes 1.0 (only Janes-news, Janes-forum, Janes-blog, Janes-wiki subcorpora)
17
  * Slovenian parliamentary corpus siParl 2.0
18
  * slWaC
19
+
20
+ ## Changelog
21
+ 2022-07-21: updated with v2 of the model, the old one is still accesible at [cjvt/legacy-t5-sl-small](https://huggingface.co/cjvt/legacy-t5-sl-small).
config.json CHANGED
@@ -22,7 +22,7 @@
22
  "relative_attention_num_buckets": 32,
23
  "tie_word_embeddings": false,
24
  "torch_dtype": "float32",
25
- "transformers_version": "4.11.0.dev0",
26
  "use_cache": true,
27
  "vocab_size": 32000
28
  }
 
22
  "relative_attention_num_buckets": 32,
23
  "tie_word_embeddings": false,
24
  "torch_dtype": "float32",
25
+ "transformers_version": "4.9.1",
26
  "use_cache": true,
27
  "vocab_size": 32000
28
  }
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2470ebb115fdfb61504459a4e1f4924759cc59cbd438b0a25b2c5258daa2f8c2
3
  size 307402757
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:891fa1f9de9d243383fe075f4e8a044b3147a842d21d05f4e7a91db19eb820c0
3
  size 307402757