Hugging Face's logo

MaziyarPanahi
/
gemma-2b-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
1
MaziyarPanahi commited on
Commit
2727147
•
1 Parent(s): 87f00df

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. .gitattributes +11 -0
  2. README.md +1 -0
  3. gemma-2b.Q2_K.gguf +3 -0
  4. gemma-2b.Q3_K_L.gguf +3 -0
  5. gemma-2b.Q3_K_M.gguf +3 -0
  6. gemma-2b.Q3_K_S.gguf +3 -0
  7. gemma-2b.Q4_K_M.gguf +3 -0
  8. gemma-2b.Q4_K_S.gguf +3 -0
  9. gemma-2b.Q5_K_M.gguf +3 -0
  10. gemma-2b.Q5_K_S.gguf +3 -0
  11. gemma-2b.Q6_K.gguf +3 -0
  12. gemma-2b.Q8_0.gguf +3 -0
  13. gemma-2b.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ gemma-2b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ gemma-2b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ gemma-2b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ gemma-2b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ gemma-2b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ gemma-2b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ gemma-2b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ gemma-2b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ gemma-2b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ gemma-2b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
+ gemma-2b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -36,6 +36,7 @@ tags:
36
  - arxiv:1804.09301
37
  - arxiv:2109.07958
38
  - arxiv:2203.09509
 
39
  - autotrain_compatible
40
  - endpoints_compatible
41
  - has_space
 
36
  - arxiv:1804.09301
37
  - arxiv:2109.07958
38
  - arxiv:2203.09509
39
+ - license:other
40
  - autotrain_compatible
41
  - endpoints_compatible
42
  - has_space
gemma-2b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21ab8f36ea9d62570612f3dd3c4945f1c6017b0e09027d326b6ffec7619fbc20
3
+ size 899965856
gemma-2b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e013b2ddaefc41323b3723a72f2efa3d6d27c57a00e5005412f157d71beafeb1
3
+ size 1260907424
gemma-2b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16b27e88e9676ef81f8e2614809c523be9b2517e37b7dcd1fe1516c6b5d435fe
3
+ size 1179118496
gemma-2b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10c20e438dd517eaa17b8ec5d54ce5b739d6124af645568b2abb16a5cafc8820
3
+ size 1083296672
gemma-2b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:081e46c21dc7f3d7c33ee9a0be46587419668311b40a93d634eb524692c3e15c
3
+ size 1495245728
gemma-2b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bc0a57500c678e69f392274f532f795866c6d554d9b8fb330b57bb401b13395
3
+ size 1424823200
gemma-2b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:706a9820271d737ab5ab2538e3d413f4ccff20f51362d4f75a4c79f64f90b583
3
+ size 1770202016
gemma-2b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ce45b2371923975a6b26e71ec80f210086cc7af30afec4670c61b5b12453954
3
+ size 1729467296
gemma-2b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1987c4ab33037f166061830764d68dbcdec5646ad35479d2acc6e29d9154ab6b
3
+ size 2062343072
gemma-2b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:768ccb3cf3d34111dd0e9659846dcc14b0cd2dfaf6229756b749b29b0bd1ea46
3
+ size 2669351840
gemma-2b.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:084eb1abf609fe1735c2631f818bd24e93d29428fd2ba096852012152e37d14b
3
+ size 10031780672