Hugging Face's logo

legraphista
/
Mistral-7B-Instruct-v0.3-IMat-GGUF

Text Generation
GGUF
quantized
GGUF
imatrix
quantization
imat
static
Model card Files Community
legraphista commited on
Commit
46584fc
•
1 Parent(s): 43b4718

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -65,7 +65,7 @@ Link: [here](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GG
65
  | [Mistral-7B-Instruct-v0.3.Q3_K_L.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q3_K_L.gguf) | Q3_K_L | 3.83GB | ✅ Available | 🟢 Yes | 📦 No
66
  | [Mistral-7B-Instruct-v0.3.Q3_K_S.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q3_K_S.gguf) | Q3_K_S | 3.17GB | ✅ Available | 🟢 Yes | 📦 No
67
  | [Mistral-7B-Instruct-v0.3.Q2_K_S.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q2_K_S.gguf) | Q2_K_S | 2.53GB | ✅ Available | 🟢 Yes | 📦 No
68
- | Mistral-7B-Instruct-v0.3.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 Yes | -
69
  | Mistral-7B-Instruct-v0.3.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 Yes | -
70
  | Mistral-7B-Instruct-v0.3.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 Yes | -
71
  | Mistral-7B-Instruct-v0.3.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 Yes | -
 
65
  | [Mistral-7B-Instruct-v0.3.Q3_K_L.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q3_K_L.gguf) | Q3_K_L | 3.83GB | ✅ Available | 🟢 Yes | 📦 No
66
  | [Mistral-7B-Instruct-v0.3.Q3_K_S.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q3_K_S.gguf) | Q3_K_S | 3.17GB | ✅ Available | 🟢 Yes | 📦 No
67
  | [Mistral-7B-Instruct-v0.3.Q2_K_S.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.Q2_K_S.gguf) | Q2_K_S | 2.53GB | ✅ Available | 🟢 Yes | 📦 No
68
+ | [Mistral-7B-Instruct-v0.3.IQ4_NL.gguf](https://huggingface.co/legraphista/Mistral-7B-Instruct-v0.3-IMat-GGUF/blob/main/Mistral-7B-Instruct-v0.3.IQ4_NL.gguf) | IQ4_NL | 4.13GB | ✅ Available | 🟢 Yes | 📦 No
69
  | Mistral-7B-Instruct-v0.3.IQ4_XS | IQ4_XS | - | ⏳ Processing | 🟢 Yes | -
70
  | Mistral-7B-Instruct-v0.3.IQ3_M | IQ3_M | - | ⏳ Processing | 🟢 Yes | -
71
  | Mistral-7B-Instruct-v0.3.IQ3_S | IQ3_S | - | ⏳ Processing | 🟢 Yes | -