dranger003
/

gemma-7b-it-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

gemma-7b-it-iMat.GGUF

1 contributor

History: 19 commits

dranger003's picture

Upload ggml-gemma-7b-it-q3_k_xs.gguf

dae9fd9 verified 8 months ago

.gitattributes

2.1 kB

Upload ggml-gemma-7b-it-q3_k_xs.gguf 8 months ago
README.md

3.76 kB

Update README.md 8 months ago
ggml-gemma-7b-it-f16-imatrix.dat

4.94 MB
LFS

Upload ggml-gemma-7b-it-f16-imatrix.dat 8 months ago
ggml-gemma-7b-it-f16.gguf

17.1 GB
LFS

Upload 2 files 8 months ago
ggml-gemma-7b-it-iq3_m.gguf

4.11 GB
LFS

Upload ggml-gemma-7b-it-iq3_m.gguf 8 months ago
ggml-gemma-7b-it-iq3_s.gguf

3.98 GB
LFS

Upload ggml-gemma-7b-it-iq3_s.gguf 8 months ago
ggml-gemma-7b-it-iq3_xxs.gguf

3.64 GB
LFS

Upload ggml-gemma-7b-it-iq3_xxs.gguf 8 months ago
ggml-gemma-7b-it-q3_k_xs.gguf

3.8 GB
LFS

Upload ggml-gemma-7b-it-q3_k_xs.gguf 8 months ago
ggml-gemma-7b-it-q4_k_m.gguf

5.33 GB
LFS

Upload ggml-gemma-7b-it-q4_k_m.gguf 8 months ago
ggml-gemma-7b-it-q6_k.gguf

7.01 GB
LFS

Upload ggml-gemma-7b-it-q6_k.gguf 8 months ago
ggml-gemma-7b-it-q8_0.gguf

9.08 GB
LFS

Upload 2 files 8 months ago