Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
Intel/neural-chat-7b-v3-2
LLMs
math
Intel
en
dataset:meta-math/MetaMathQA
arxiv:2309.12284
Eval Results
Inference Endpoints
neural-chat-7b-v3-2-Mistral-7B-Instruct-v0.1-GGUF
/
neural-chat-7b-v3-2-Mistral-7B-Instruct-v0.1.Q2_K.gguf