Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
NousResearch/Yarn-Mistral-7b-64k
custom_code
en
dataset:emozilla/yarn-train-tokenized-16k-mistral
arxiv:2309.00071
Inference Endpoints
conversational
Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-GGUF
/
Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1.Q4_K_M.gguf