QuantFactory
/

Mistral-7B-v0.3-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-v0.3-GGUF

1 contributor

History: 13 commits

munish0838's picture

Upload Mistral-7B-v0.3.Q3_K_L.gguf with huggingface_hub

3c67f3d verified about 1 month ago

.gitattributes

2.21 kB

Upload Mistral-7B-v0.3.Q3_K_L.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q3_K_L.gguf

3.83 GB
LFS

Upload Mistral-7B-v0.3.Q3_K_L.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q4_0.gguf

4.11 GB
LFS

Upload Mistral-7B-v0.3.Q4_0.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q4_1.gguf
4.56 GB
LFS

Upload Mistral-7B-v0.3.Q4_1.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q4_K_M.gguf
4.37 GB
LFS

Upload Mistral-7B-v0.3.Q4_K_M.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q4_K_S.gguf

4.14 GB
LFS

Upload Mistral-7B-v0.3.Q4_K_S.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q5_0.gguf
5 GB
LFS

Upload Mistral-7B-v0.3.Q5_0.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q5_1.gguf
5.45 GB
LFS

Upload Mistral-7B-v0.3.Q5_1.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q5_K_M.gguf
5.14 GB
LFS

Upload Mistral-7B-v0.3.Q5_K_M.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q5_K_S.gguf
5 GB
LFS

Upload Mistral-7B-v0.3.Q5_K_S.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q6_K.gguf
5.95 GB
LFS

Upload Mistral-7B-v0.3.Q6_K.gguf with huggingface_hub about 1 month ago
Mistral-7B-v0.3.Q8_0.gguf
7.7 GB
LFS

Upload Mistral-7B-v0.3.Q8_0.gguf with huggingface_hub about 1 month ago
README.md

3.23 kB

Create README.md about 1 month ago