areegtarek's picture
Upload tokenizer
c0011bc verified
{
"<end_of_utterance>": 32002,
"<fake_token_around_image>": 32000,
"<image>": 32001
}