Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
arxiv:2305.14314
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Upload folder using huggingface_hub
#2
by
MaziyarPanahi
- opened
- gemma-7b.Q2_K.gguf +2 -2
- gemma-7b.Q3_K_L.gguf +2 -2
- gemma-7b.Q3_K_M.gguf +2 -2
- gemma-7b.Q3_K_S.gguf +2 -2
- gemma-7b.Q4_K_M.gguf +2 -2
- gemma-7b.Q4_K_S.gguf +2 -2
- gemma-7b.Q5_K_M.gguf +2 -2
- gemma-7b.Q5_K_S.gguf +2 -2
- gemma-7b.Q6_K.gguf +2 -2
- gemma-7b.Q8_0.gguf +2 -2
- gemma-7b.fp16.gguf +2 -2
gemma-7b.Q2_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:68ee42487e7f322544b4e1e0b575e55591422853430d493030a49a19b2288ff8
|
3 |
+
size 3481446784
|
gemma-7b.Q3_K_L.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9e1136b30aa560821b51b596ae538dbdf93480ba0d7a864fbcdfdd1875737b6d
|
3 |
+
size 4709067136
|
gemma-7b.Q3_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e43411826582afcd53d711602bf3c6ed278f4d14011b981345ec8bc78d9c0b5c
|
3 |
+
size 4369328512
|
gemma-7b.Q3_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0a30b63fca8f8f6cb311f1117d9e0e01ef5da719f8613b7fce7c0ada791c3fed
|
3 |
+
size 3982403968
|
gemma-7b.Q4_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:98a8dc3d27f8df908f9084096feaf3efec7098be4e715552becb63a1a8125c84
|
3 |
+
size 5329758592
|
gemma-7b.Q4_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8b61792872f01b72df8c32e5f98f3ae0dadc8baa1b4f0570315cb499a608160e
|
3 |
+
size 5046446464
|
gemma-7b.Q5_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:218e770a4f42f0a73255bddde86cf1a8ecc106eb666d2f3fffb486bcabcb2c6e
|
3 |
+
size 6144502144
|
gemma-7b.Q5_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b1f8e4598d6a93a9f900c875ff5cbd43e122a1b49e1795b70da8a02c867a102f
|
3 |
+
size 5980727680
|
gemma-7b.Q6_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2c8ed65f789a9a411400a1b3e8d8311956f3a4a4d1ea46ea67356d379f9caaf9
|
3 |
+
size 7010167168
|
gemma-7b.Q8_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6006d8fb566ccbcd79fc75c1cae30bf7e12b4e32521e016f43c93b9fee7a50d2
|
3 |
+
size 9077844352
|
gemma-7b.fp16.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cff38939b6b3ada36b147aeffd2ceab51e3966a2b231d1f5d35ad881f3b4dc72
|
3 |
+
size 17081755968
|