Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
Intel/neural-chat-7b-v3
LLMs
Intel
en
dataset:Open-Orca/SlimOrca
arxiv:2306.02707
Eval Results
Inference Endpoints
neural-chat-7b-v3-Mistral-7B-Instruct-v0.1-GGUF
/
neural-chat-7b-v3-Mistral-7B-Instruct-v0.1.Q6_K.gguf