gpt2-small-turkish / tokenizer_config.json
gorkemgoknar's picture
V2 -86 perpex %28 Accurary -- 0 4.610025 4.462641 0.289884 86.716248 2:34:50
df3cec8
raw history blame
No virus
92 Bytes
{"pad_token": "<|endoftext|>", "special_tokens_map_file": null, "full_tokenizer_file": null}