Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
uukuguy/speechless-mistral-dolphin-orca-platypus-samantha-7b-dare-0.85
Inference Endpoints
speechless-mistral-dolphin-orca-platypus-samantha-7b-dare-0.85-Mistral-7B-Instruct-v0.1-GGUF
/
speechless-mistral-dolphin-orca-platypus-samantha-7b-dare-0.85-Mistral-7B-Instruct-v0.1.Q4_K_S.gguf