kykim
/

gpt3-kor-small_based_on_gpt2

Text Generation Transformers PyTorch TensorFlow JAX Korean gpt2 Inference Endpoints text-generation-inference

Model card Files Files and versions Community

kykim commited on Jan 1, 2023

Commit

cfe4828

•

1 Parent(s): e47e807

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +2 -1

tokenizer_config.json CHANGED Viewed

@@ -1,5 +1,6 @@
 {
   "do_lower_case": true,
   "strip_accents": false,
-  "model_max_length": 2048
 }

 {
   "do_lower_case": true,
   "strip_accents": false,
+  "model_max_length": 2048,
+  "tokenizer_class": "BertTokenizer"
 }