ct2fast-pythia-160m / special_tokens_map.json
michaelfeil's picture
Upload EleutherAI/pythia-160m ctranslate fp16 weights
deab3ca
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}