Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
dranger003
/
Smaug-Mixtral-v0.1-iMat.GGUF
like
2
Text Generation
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
6931105
Smaug-Mixtral-v0.1-iMat.GGUF
1 contributor
History:
26 commits
dranger003
Update README.md
6931105
verified
7 months ago
.gitattributes
2.9 kB
Upload ggml-smaug-mixtral-v0.1-iq2_s.gguf
7 months ago
README.md
1.85 kB
Update README.md
7 months ago
ggml-smaug-mixtral-v0.1-f16.gguf.aa
50 GB
LFS
Upload ggml-smaug-mixtral-v0.1-f16.gguf.aa
7 months ago
ggml-smaug-mixtral-v0.1-f16.gguf.ab
50 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-f16.gguf.ac
50 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-f16.gguf.ad
36.8 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-iq2_m.gguf
15.5 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-iq2_s.gguf
14.1 GB
LFS
Upload ggml-smaug-mixtral-v0.1-iq2_s.gguf
7 months ago
ggml-smaug-mixtral-v0.1-iq2_xs.gguf
13.7 GB
LFS
Upload ggml-smaug-mixtral-v0.1-iq2_xs.gguf
7 months ago
ggml-smaug-mixtral-v0.1-iq2_xxs.gguf
12.3 GB
LFS
Upload ggml-smaug-mixtral-v0.1-iq2_xxs.gguf
7 months ago
ggml-smaug-mixtral-v0.1-iq3_m.gguf
21.4 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-iq3_s.gguf
20.4 GB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-iq3_xxs.gguf
18.3 GB
LFS
Upload ggml-smaug-mixtral-v0.1-iq3_xxs.gguf
7 months ago
ggml-smaug-mixtral-v0.1-q3_k_m.gguf
22.5 GB
LFS
Upload ggml-smaug-mixtral-v0.1-q3_k_m.gguf
7 months ago
ggml-smaug-mixtral-v0.1-q3_k_xs.gguf
19.3 GB
LFS
Upload ggml-smaug-mixtral-v0.1-q3_k_xs.gguf
7 months ago
ggml-smaug-mixtral-v0.1-q4_k_m.gguf
28.4 GB
LFS
Upload ggml-smaug-mixtral-v0.1-q4_k_m.gguf
7 months ago
ggml-smaug-mixtral-v0.1-q5_k_m.gguf
33.2 GB
LFS
Upload ggml-smaug-mixtral-v0.1-q5_k_m.gguf
7 months ago
ggml-smaug-mixtral-v0.1-q8_0-1-imatrix.dat
25.7 MB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-q8_0-2-imatrix.dat
25.7 MB
LFS
Upload 3 files
7 months ago
ggml-smaug-mixtral-v0.1-q8_0-imatrix.dat
25.7 MB
LFS
Upload ggml-smaug-mixtral-v0.1-q8_0-imatrix.dat
7 months ago
ggml-smaug-mixtral-v0.1-q8_0.gguf
49.6 GB
LFS
Upload 3 files
7 months ago