Hugging Face's logo

MaziyarPanahi
/
gemma-2b-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
1

Upload folder using huggingface_hub

#1
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+22
-22
Files changed (11) hide show
  1. gemma-2b.Q2_K.gguf +2 -2
  2. gemma-2b.Q3_K_L.gguf +2 -2
  3. gemma-2b.Q3_K_M.gguf +2 -2
  4. gemma-2b.Q3_K_S.gguf +2 -2
  5. gemma-2b.Q4_K_M.gguf +2 -2
  6. gemma-2b.Q4_K_S.gguf +2 -2
  7. gemma-2b.Q5_K_M.gguf +2 -2
  8. gemma-2b.Q5_K_S.gguf +2 -2
  9. gemma-2b.Q6_K.gguf +2 -2
  10. gemma-2b.Q8_0.gguf +2 -2
  11. gemma-2b.fp16.gguf +2 -2
gemma-2b.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21ab8f36ea9d62570612f3dd3c4945f1c6017b0e09027d326b6ffec7619fbc20
3
- size 899965856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9c186061188e90ee357773e184ed722ec88f40f5aa04eb886bbc39a2ca50620
3
+ size 1157923968
gemma-2b.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e013b2ddaefc41323b3723a72f2efa3d6d27c57a00e5005412f157d71beafeb1
3
- size 1260907424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7483357519f202ca51a51282241e895c7e5dbdfc722de9e3a24df7be70f470c6
3
+ size 1465590912
gemma-2b.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:16b27e88e9676ef81f8e2614809c523be9b2517e37b7dcd1fe1516c6b5d435fe
3
- size 1179118496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1397432691e7c5c46a214f596120e016a2c3b21be73c0826a483b45042bda6af
3
+ size 1383801984
gemma-2b.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:10c20e438dd517eaa17b8ec5d54ce5b739d6124af645568b2abb16a5cafc8820
3
- size 1083296672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:891512d8b0ed8c0881ebc4f13802024d6fe11cb78622503405ebb463c1de4a32
3
+ size 1287980160
gemma-2b.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:081e46c21dc7f3d7c33ee9a0be46587419668311b40a93d634eb524692c3e15c
3
- size 1495245728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb917cb350bb415b13bcfc03af09ef18e406ce51892b815851101808b6805ad1
3
+ size 1630262400
gemma-2b.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3bc0a57500c678e69f392274f532f795866c6d554d9b8fb330b57bb401b13395
3
- size 1424823200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5187849f1db2d487789d1196412c87ba0d0c368fbfe009e8b1ddbb79d15e994
3
+ size 1559839872
gemma-2b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:706a9820271d737ab5ab2538e3d413f4ccff20f51362d4f75a4c79f64f90b583
3
- size 1770202016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d14e17221150412ac90916874e90ed9e2059e4e4ae341d77832fb720d1b6ffdc
3
+ size 1839649920
gemma-2b.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ce45b2371923975a6b26e71ec80f210086cc7af30afec4670c61b5b12453954
3
- size 1729467296
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd8612e03e5817dda605efbb9a8c546ae4618dac7fba29f639a3ffbacffd1765
3
+ size 1798915200
gemma-2b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1987c4ab33037f166061830764d68dbcdec5646ad35479d2acc6e29d9154ab6b
3
- size 2062343072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68e4baa99b96c40d316740534e21b388027f4883121395da22bb070b5a3a7ce8
3
+ size 2062124160
gemma-2b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:768ccb3cf3d34111dd0e9659846dcc14b0cd2dfaf6229756b749b29b0bd1ea46
3
- size 2669351840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75bf2aa6d3879525cff58408c2d2435d8bd0594846ee5fe8b959cd991cdbb005
3
+ size 2669069440
gemma-2b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:084eb1abf609fe1735c2631f818bd24e93d29428fd2ba096852012152e37d14b
3
- size 10031780672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:781281fb4ae2f7aaa352f54adc37fd35bdb5f45567795416c8fbffdd31b20e14
3
+ size 5018534976