12412fsasf / added_tokens.json
p-christ's picture
add tokenizer
42f401f
raw
history blame
31 Bytes
{"<sep>": 32100, "<hl>": 32101}