kvaishnavi's picture
Update Phi-3-small-128k-instruct tokenizer
de05e6e
raw
history blame
71 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>"
}