Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Lewdiculous
/
firefly-gemma-7b-GGUF-IQ-Imatrix
like
2
GGUF
gemma
quantized
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Use this model
8a3a355
firefly-gemma-7b-GGUF-IQ-Imatrix
1 contributor
History:
6 commits
Lewdiculous
Upload 6 files
8a3a355
verified
7 months ago
.gitattributes
Safe
2.74 kB
Upload 6 files
7 months ago
README.md
Safe
4.4 kB
Update README.md
7 months ago
firefly-gemma-7b-F16.gguf
17.1 GB
LFS
Upload 7 files
7 months ago
firefly-gemma-7b-IQ2_M-imatrix.gguf
3.13 GB
LFS
Upload 7 files
7 months ago
firefly-gemma-7b-IQ2_S-imatrix.gguf
2.92 GB
LFS
Upload 7 files
7 months ago
firefly-gemma-7b-IQ2_XS-imatrix.gguf
2.81 GB
LFS
Upload 7 files
7 months ago
firefly-gemma-7b-IQ2_XXS-imatrix.gguf
2.59 GB
LFS
Upload 7 files
7 months ago
firefly-gemma-7b-IQ3_M-imatrix.gguf
4.11 GB
LFS
Upload 6 files
7 months ago
firefly-gemma-7b-IQ3_S-imatrix.gguf
3.98 GB
LFS
Upload 6 files
7 months ago
firefly-gemma-7b-IQ3_XS-imatrix.gguf
3.8 GB
LFS
Upload 6 files
7 months ago
firefly-gemma-7b-IQ3_XXS-imatrix.gguf
3.49 GB
LFS
Upload 6 files
7 months ago
firefly-gemma-7b-IQ4_XS-imatrix.gguf
4.77 GB
LFS
Upload 5 files
7 months ago
firefly-gemma-7b-Q3_K_M-imatrix.gguf
4.37 GB
LFS
Upload 6 files
7 months ago
firefly-gemma-7b-Q4_K_S-imatrix.gguf
5.05 GB
LFS
Upload 5 files
7 months ago
firefly-gemma-7b-Q5_K_M-imatrix.gguf
6.14 GB
LFS
Upload 5 files
7 months ago
firefly-gemma-7b-Q5_K_S-imatrix.gguf
5.98 GB
LFS
Upload 5 files
7 months ago
firefly-gemma-7b-Q6_K-imatrix.gguf
7.01 GB
LFS
Upload 5 files
7 months ago
firefly-gemma-7b-Q8_0-imatrix.gguf
9.08 GB
LFS
Upload 6 files
7 months ago
imatrix-firefly-gemma-7b-F16.dat
Safe
4.94 MB
LFS
Upload 7 files
7 months ago
kalomaze's-groups_merged.txt
Safe
201 kB
Upload 7 files
7 months ago
