GPT4-x-AlpacaDente2-30b / added_tokens.json
Aeala's picture
Add oasst tokens.
9fe5a8d
{
"<|assistant|>": 32004,
"<|prefix_begin|>": 32000,
"<|prefix_end|>": 32003,
"<|prompter|>": 32002,
"<|system|>": 32001
}