cv-full-paper / added_tokens.json
zyayoung's picture
add tokenizer
a4abe71
raw
history blame contribute delete
133 Bytes
{" <|fancy_abbr|>": 50260, " <|reference|>": 50261, "<|title|>": 50257, " <|text|>": 50258, " <|url|>": 50262, " <|section|>": 50259}