Hugging Face's logo

MaziyarPanahi
/
gemma-7b-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2305.14314
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
5
MaziyarPanahi commited on
Commit
02e9279
•
1 Parent(s): 1b1d03c

Upload folder using huggingface_hub (#2)

Browse files

- eaf39fa370e66974ca0a6cba918f99c2b5fe78523eb36713e81009d0c3435d93 (1ad03909a453dff9064315718fb656f5d584b13f)
- 41fe86d148d55489e90dac630467864c97c0b4d7bc837833c52b6b34ff3febee (838dac75217f28aef68dbc4c9073271bece02414)
- 5c34d6a7e66287d10f7c404727ea57337ff82fbd07032e9e0174a0cb143a517a (306fb34efb9dd55741008405ae5dc818b4c99f50)
- 1d9d3353412c4c831f93d92f21f2264d05b7199f74a046f46834dee0b2ce920e (40710485a9d84fd5c10839f69afad34dc9addd37)
- f543d6d0ed329bd1ead24b2788e380053b4da17d20be81c8e6d2c0f515306fb0 (850e77e99802c14ad67ce47520a1e3b19c309167)
- d7d4254b0170aec35c0eb26afd4b34ba8d26b24625925bca6fa215c29d86d176 (df68da45af1994622a4a0cfcd91e761e3932be20)
- aeb85afd9d933223cf9be737ca91cba9197c2310210c1d2bc12681ac745eb23a (4faf9c36983c8ee707ad3d79a347fa1ac037d4a0)
- 4d21510e59ff3e67a0a14e37e2efd44ade69500e1afeb0d831185cff12a25aa9 (3f9e1c26b669dd29cc9fe5505c7c28f395505731)
- 3d9ebbb4d8f768dc3fd1ba36b0b4a933fbc7c13a90c2fde69f7da06db436d0ea (c9628cd154871846eb727e324a5c2fac8e3e699e)
- d03454529d45ab94d0cbb7e14c3c6948cf2a290d9f359d9bdeca9f09155505f5 (cafe3ba6d744be3d5eed79b2efd312e0235e9d1f)
- 96b116106a80086d269b54ab228274f7a68f53bc16efca5e9410986796c6abd8 (d535e5149fb192c8b71870b260a8645b8e21f55b)
- bd022949471ab4445843115ad6e72f88ee8e6550e2dcadf0670fb4e2b4766cc4 (ab9f4b1eb436c80db60e5cf930698e2702f9e1c3)

Files changed (11) hide show
  1. gemma-7b.Q2_K.gguf +2 -2
  2. gemma-7b.Q3_K_L.gguf +2 -2
  3. gemma-7b.Q3_K_M.gguf +2 -2
  4. gemma-7b.Q3_K_S.gguf +2 -2
  5. gemma-7b.Q4_K_M.gguf +2 -2
  6. gemma-7b.Q4_K_S.gguf +2 -2
  7. gemma-7b.Q5_K_M.gguf +2 -2
  8. gemma-7b.Q5_K_S.gguf +2 -2
  9. gemma-7b.Q6_K.gguf +2 -2
  10. gemma-7b.Q8_0.gguf +2 -2
  11. gemma-7b.fp16.gguf +2 -2
gemma-7b.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fd3c06a8200fc8bd9fd7e6678bb9b5e70d836fa0b405a7bc9d1f0f5b4d17a27b
3
- size 3094507680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68ee42487e7f322544b4e1e0b575e55591422853430d493030a49a19b2288ff8
3
+ size 3481446784
gemma-7b.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7837fb5e6d01b87ba5cf02194a9df0bda681902e1c210bdb752312c42e144b04
3
- size 4402039968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e1136b30aa560821b51b596ae538dbdf93480ba0d7a864fbcdfdd1875737b6d
3
+ size 4709067136
gemma-7b.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:991a15d5661a2e42d9c8aba486659c8a43951053a650e575b2edae101b15e576
3
- size 4062301344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e43411826582afcd53d711602bf3c6ed278f4d14011b981345ec8bc78d9c0b5c
3
+ size 4369328512
gemma-7b.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5875b87b4a38aab15788f3bbd16919d8e1a2e8ed6b243109e5a4f4fcaedae8af
3
- size 3675376800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a30b63fca8f8f6cb311f1117d9e0e01ef5da719f8613b7fce7c0ada791c3fed
3
+ size 3982403968
gemma-7b.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:055d07a2b61e83b8d23198b6d0bd4c2b60848033d23bad648675c62f23eacdea
3
- size 5127231648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98a8dc3d27f8df908f9084096feaf3efec7098be4e715552becb63a1a8125c84
3
+ size 5329758592
gemma-7b.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a197785f5d49af20991015dcd62df83c0c87f7aab2ff56a032ea8a54002ddfd7
3
- size 4843919520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b61792872f01b72df8c32e5f98f3ae0dadc8baa1b4f0570315cb499a608160e
3
+ size 5046446464
gemma-7b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:80e14c828b57b0e0cf739c7c34c35c67e47f2a43ad473a6fff35d2d8ce2a4592
3
- size 6040328352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:218e770a4f42f0a73255bddde86cf1a8ecc106eb666d2f3fffb486bcabcb2c6e
3
+ size 6144502144
gemma-7b.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d74e4662fd18f428415641961d52126eb307efe4d1ac210f4785046e8864cc4
3
- size 5876553888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1f8e4598d6a93a9f900c875ff5cbd43e122a1b49e1795b70da8a02c867a102f
3
+ size 5980727680
gemma-7b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93ea627826289539068817d044b87c523222f3e2b3d0d10176bac34292bce188
3
- size 7010493600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c8ed65f789a9a411400a1b3e8d8311956f3a4a4d1ea46ea67356d379f9caaf9
3
+ size 7010167168
gemma-7b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f72310ab83b94033356b9491f37b0a0036a16c47a65307439862cdbb3462aa5
3
- size 9078266016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6006d8fb566ccbcd79fc75c1cae30bf7e12b4e32521e016f43c93b9fee7a50d2
3
+ size 9077844352
gemma-7b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1f4aabd3db466eb1c8ff792efa7647cf02e56202574b9cdd555c2df32d5af43
3
- size 34158344288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cff38939b6b3ada36b147aeffd2ceab51e3966a2b231d1f5d35ad881f3b4dc72
3
+ size 17081755968