ViTGPT_Chess_comment_DGX_V3 / added_tokens.json
Migga's picture
add tokenizer
bb9ba77
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}