Text Generation
Transformers
Safetensors
llama
conversational
Inference Endpoints
text-generation-inference
exl2
Smaug-Llama-3-70B-Instruct-bpw2.5-exl2 / generation_config.json
blockblockblock's picture
Upload folder using huggingface_hub
ace1d97 verified
{
"_from_model_config": true,
"bos_token_id": 128000,
"eos_token_id": [
128001,
128009
],
"transformers_version": "4.40.0"
}