Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
gemma-gemma-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
mergekit
Merge
conversational
arxiv:2212.04089
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
gemma-gemma-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
4678c0c70df7065ae442e5be87cd4edc432571264502b374d6f654bd9341aa2a
375ac42
verified
about 11 hours ago
.gitattributes
2.11 kB
85507caf8fae0a24efe3a80bda652041e3076ec0d893e34757e90ad8bb7a0069
about 11 hours ago
README.md
3.25 kB
4678c0c70df7065ae442e5be87cd4edc432571264502b374d6f654bd9341aa2a
about 11 hours ago
gemma-gemma.Q2_K.gguf
2.72 GB
LFS
ea66ff7306bd9c1bcdea3b6831764cc69ec238539df67997a288e9b94e8502a2
about 12 hours ago
gemma-gemma.Q3_K_L.gguf
3.82 GB
LFS
22b3b5c48982d66467c138836745a58862086334d236034e90d25169202e5f58
about 12 hours ago
gemma-gemma.Q3_K_M.gguf
3.52 GB
LFS
22dee436771024ff5ee7907acffe31ca1ee5a86fd852cc03fb349e0d1ff231fd
about 12 hours ago
gemma-gemma.Q3_K_S.gguf
3.16 GB
LFS
f58c6e2ad4b6d53492b48919500d912c8f1078070ab5d12d90da734eb9d4275c
about 12 hours ago
gemma-gemma.Q4_K_M.gguf
4.37 GB
LFS
71d85bf1b5f5cdfcb6e09791ea783cbc114578c792a875f756bfb60ae075a34b
about 11 hours ago
gemma-gemma.Q4_K_S.gguf
4.14 GB
LFS
06c5c74ee0c02459466567ef8c98842ddc50772a5ef137d84e8abbfc71980a6a
about 11 hours ago
gemma-gemma.Q5_K_M.gguf
5.13 GB
LFS
707cdcdcca28e20be0f070c629547e75661141567811382ade4c6ceb44c04875
about 11 hours ago
gemma-gemma.Q5_K_S.gguf
5 GB
LFS
8071a4e3ea891d28665d4fb1d5ee2fec5e55513670298dce90d9ac43fac76084
about 11 hours ago
gemma-gemma.Q6_K.gguf
5.94 GB
LFS
8506c143ab429c266b3e6b42098abbe359f9940bd512f307087579ea550c3c81
about 11 hours ago
gemma-gemma.Q8_0.gguf
7.7 GB
LFS
85507caf8fae0a24efe3a80bda652041e3076ec0d893e34757e90ad8bb7a0069
about 11 hours ago
