llama-7b-tokenizer / added_tokens.json
SaulLu's picture
Upload tokenizer
028d5f3
{
"<fake_token_around_image>": 32000,
"<image>": 32001
}