Hugging Face's logo

X-Wang
/
pruned-mt5-small

Text2Text Generation
Transformers
PyTorch
Japanese
Chinese
mt5
Generated from Trainer
Inference Endpoints
Model card Files Community
9
X-Wang commited on
Commit
8651399
•
1 Parent(s): 3343e81

Upload tokenizer

Browse files
Files changed (3) hide show
  1. spiece.model +2 -2
  2. tokenizer.json +2 -2
  3. tokenizer_config.json +1 -0
spiece.model CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:545945da9ea041648dd5364f91ebbd6cf15d1d734511e7f64ca91a10bdd434e1
3
- size 997537
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de4b781d90f027ff34a8c5fb987d2e1f1134f3460e395599f8822cc95a142d51
3
+ size 927840
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8df7d3ceebe071e7fb65e8f21558150a0ef9abec28d95ae505799d803e500b8e
3
- size 3195678
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aed4b57ade9307756077e2343a25c2fa498b176d3803dd362d0214c6c48b145f
3
+ size 2849939
tokenizer_config.json CHANGED
@@ -3,6 +3,7 @@
3
  "clean_up_tokenization_spaces": true,
4
  "eos_token": "</s>",
5
  "extra_ids": 0,
 
6
  "model_max_length": 1000000000000000019884624838656,
7
  "pad_token": "<pad>",
8
  "sp_model_kwargs": {},
 
3
  "clean_up_tokenization_spaces": true,
4
  "eos_token": "</s>",
5
  "extra_ids": 0,
6
+ "legacy": true,
7
  "model_max_length": 1000000000000000019884624838656,
8
  "pad_token": "<pad>",
9
  "sp_model_kwargs": {},