dranger003
/

Smaug-Mixtral-v0.1-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Smaug-Mixtral-v0.1-iMat.GGUF

1 contributor

History: 16 commits

dranger003's picture

Upload ggml-smaug-mixtral-v0.1-f16.gguf.aa

a224d3d verified 8 months ago

.gitattributes

2.1 kB

Upload ggml-smaug-mixtral-v0.1-f16.gguf.aa 8 months ago
README.md

874 Bytes

Update README.md 8 months ago
ggml-smaug-mixtral-v0.1-f16.gguf.aa

50 GB
LFS

Upload ggml-smaug-mixtral-v0.1-f16.gguf.aa 8 months ago
ggml-smaug-mixtral-v0.1-iq2_xs.gguf

13.7 GB
LFS

Upload ggml-smaug-mixtral-v0.1-iq2_xs.gguf 8 months ago
ggml-smaug-mixtral-v0.1-iq2_xxs.gguf

12.3 GB
LFS

Upload ggml-smaug-mixtral-v0.1-iq2_xxs.gguf 8 months ago
ggml-smaug-mixtral-v0.1-iq3_xxs.gguf

18.3 GB
LFS

Upload ggml-smaug-mixtral-v0.1-iq3_xxs.gguf 8 months ago
ggml-smaug-mixtral-v0.1-q3_k_m.gguf

22.5 GB
LFS

Upload ggml-smaug-mixtral-v0.1-q3_k_m.gguf 8 months ago
ggml-smaug-mixtral-v0.1-q4_k_m.gguf

28.4 GB
LFS

Upload ggml-smaug-mixtral-v0.1-q4_k_m.gguf 8 months ago
ggml-smaug-mixtral-v0.1-q5_k_m.gguf

33.2 GB
LFS

Upload ggml-smaug-mixtral-v0.1-q5_k_m.gguf 8 months ago
ggml-smaug-mixtral-v0.1-q8_0-imatrix.dat

25.7 MB
LFS

Upload ggml-smaug-mixtral-v0.1-q8_0-imatrix.dat 8 months ago