Text Generation
Transformers
Safetensors
qwen2
Generated from Trainer
axolotl
conversational
Inference Endpoints
text-generation-inference
6-bit
exl2
dolphin-2.9.2-qwen2-7b-bpw6-exl2 / generation_config.json
blockblockblock's picture
Upload folder using huggingface_hub
12bf567 verified
{
"bos_token_id": 151643,
"do_sample": true,
"eos_token_id": 151643,
"max_new_tokens": 2048,
"transformers_version": "4.40.2"
}