gpt2-medium-indonesian / added_tokens.json
alvinwatner's picture
change endoftext value to len of tokenizer vocab size
07fc755
raw history blame
No virus
24 Bytes
{"<|endoftext|>": 50257}