G24_BTECH_PROJECT-step2 / added_tokens.json
Shruti9756's picture
Upload tokenizer
15c46fb
raw
history blame contribute delete
21 Bytes
{
"[PAD]": 49152
}