Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
jpodivin
/
Mistral-7B-Instruct-v0.2-GGUF
like
0
Text Generation
Transformers
GGUF
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
Mistral-7B-Instruct-v0.2-GGUF
Mistral-7B-Instruct-v0.2-GGUF
New batch of quantized Mistral-7B-Instruct-v0.2 models using recent versions of llama.cpp.
Downloads last month
327
GGUF
Model size
7.24B params
Architecture
llama
Q2_K
Q3_K
Q3_K
Q3_K
Q4_0
Q4_1
Q4_K
Q4_K
Q5_0
Q5_1
Q5_K
Q5_K
Q6_K
Q8_0
F16
Inference Examples
Text Generation
Inference API (serverless) has been turned off for this model.
Maximize
Quantized from
mistralai/Mistral-7B-Instruct-v0.2
