gpt2-medium-indonesian / added_tokens.json
alvinwatner's picture
change endoftext value to len of tokenizer vocab size
07fc755
{"<|endoftext|>": 50257}