Text Generation
Transformers
Safetensors
4 languages
mistral
Mistral_Star
Mistral_Quiet
Mistral
Mixtral
Question-Answer
Token-Classification
Sequence-Classification
SpydazWeb-AI
chemistry
biology
legal
code
climate
medical
text-generation-inference
Not-For-All-Audiences
Inference Endpoints
4-bit precision
bitsandbytes
{ | |
"_from_model_config": true, | |
"use_cache": false, | |
"num_beams": 4, | |
"num_return_sequences": 2, | |
"temperature": 0.7, | |
"top_p" : 0.68, | |
"top_k": 100, | |
"do_sample": true, | |
"bos_token_id": 1, | |
"eos_token_id": 2, | |
"transformers_version": "4.38.2" | |
} | |