second-stage-clf-thesis / added_tokens.json
janbakker's picture
Upload tokenizer
3624561 verified
raw
history blame contribute delete
201 Bytes
{
"<COPY>": 50270,
"<DELETE>": 50274,
"<MERGE>": 50273,
"<REPHRASE>": 50271,
"<RL_0>": 50265,
"<RL_1>": 50266,
"<RL_2>": 50267,
"<RL_3>": 50268,
"<RL_4>": 50269,
"<SPLIT>": 50272
}