dranger003
/

Smaug-72B-v0.1-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Smaug-72B-v0.1-iMat.GGUF

1 contributor

History: 9 commits

dranger003's picture

Upload ggml-smaug-72b-v0.1-iq2_s.gguf

340c17a verified 8 months ago

.gitattributes

1.93 kB

Upload ggml-smaug-72b-v0.1-iq2_s.gguf 8 months ago
README.md

1.23 kB

Update README.md 8 months ago
ggml-smaug-72b-v0.1-iq2_m.gguf

25.2 GB
LFS

Upload ggml-smaug-72b-v0.1-iq2_m.gguf 8 months ago
ggml-smaug-72b-v0.1-iq2_s.gguf

23.4 GB
LFS

Upload ggml-smaug-72b-v0.1-iq2_s.gguf 8 months ago
ggml-smaug-72b-v0.1-iq2_xs.gguf

21.8 GB
LFS

Upload ggml-smaug-72b-v0.1-iq2_xs.gguf 9 months ago
ggml-smaug-72b-v0.1-iq2_xxs.gguf

19.8 GB
LFS

Upload 2 files 9 months ago
ggml-smaug-72b-v0.1-iq3_xxs.gguf

28.7 GB
LFS

Upload ggml-smaug-72b-v0.1-iq3_xxs.gguf 9 months ago
ggml-smaug-72b-v0.1-q8_0-imatrix.dat

23.6 MB
LFS

Upload 2 files 9 months ago