lotr-gpt / added_tokens.json
beomus's picture
add tokenizer
27d8583
raw
history blame contribute delete
44 Bytes
{"<|startoftext|>": 50257, "<|pad|>": 50258}