Hugging Face's logo

MaziyarPanahi
/
gemma-7b-it-GGUF

Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
gemma
conversational
arxiv:2312.11805
arxiv:2009.03300
arxiv:1905.07830
arxiv:1911.11641
arxiv:1904.09728
arxiv:1905.10044
arxiv:1907.10641
arxiv:1811.00937
arxiv:1809.02789
arxiv:1911.01547
arxiv:1705.03551
arxiv:2107.03374
arxiv:2108.07732
arxiv:2110.14168
arxiv:2304.06364
arxiv:2206.04615
arxiv:1804.06876
arxiv:2110.08193
arxiv:2009.11462
arxiv:2101.11718
arxiv:1804.09301
arxiv:2109.07958
arxiv:2203.09509
Inference Endpoints
has_space
text-generation-inference
Model card Files Community
2
MaziyarPanahi commited on
Commit
a5a7e9b
•
1 Parent(s): 16c1251

Upload folder using huggingface_hub (#1)

Browse files

- b54f36407273a792dd612af9e3e583516d7b1f23251512c2f375f402cbf5e914 (d03f2a7d9002806b73a3acf236a380edb190d1f5)
- d26fae3e2c62e96c5c7b72a9b22e8d40987d4864b440531fe6740657460b6fe6 (dcbfa600eebab9d29254ebc68ff881369e39da2a)
- b43208c4c7fc635167fed95e39dd4f85a8cc891c63845bc09be1c5eacc04a28b (71f39834b3cfd9816bde9966cf45dab252f5c314)
- a15f0837d59156acf65097a90f0d34587a3df069b2597ba77d63f516d0c42f1c (6af867243bc4015a07b843deb9a93f51b3ea476b)
- b89e84b608e1065842d708d6dbe88fcd82b024f0ac76f4527e2a44c899b67a3d (8884775a5b5d00d257056d1720f0168bd121254e)
- ca6f70ccc5b6e4a242073396262905dacfd7385bd06df8a55ffd63e448130d20 (aa5a5d3e6d2d910bf974434bdf4db4ad30cb93cd)
- 0c742cf4fcd81bed3d22bfb7b1eea889fc1f9bf9898df4e80813e5d7ca349535 (8b9b37e5f426aa23605e80c27499b25362964886)
- f104686d33d3cbe1a8c16cf2f7fd684e254aad03d0b83cec2972433e496905ff (f38bab9ac4b4fd99ffc2c8cef9f5b582edb6e81a)
- aac9d93663231e20da08072194e272e442a5663b3352c7e8a66d3a305ea22900 (393e9fc19c758ee4c65deee3621e231f6ea73a96)
- 37dc027540f601d88d20a1e40e920586ff87a5f36e28e56e5b6242f5fde93173 (0a02a8c9902eb191c5f20547917ab2b75de209ff)
- a96dff9b412270158e05b36f9f2664c84c20d39c4d964173d6233ea5a2c121f8 (ad348d197d63edb806c71241050dc7914a4faf09)
- 5dd86f1b3d4a7762d4059524f0cab18e367ceec7d36bf139292d459090b325be (d8707b3b3cc5f37ae26106446f24cf2c3ca6d266)

Files changed (11) hide show
  1. gemma-7b-it.Q2_K.gguf +2 -2
  2. gemma-7b-it.Q3_K_L.gguf +2 -2
  3. gemma-7b-it.Q3_K_M.gguf +2 -2
  4. gemma-7b-it.Q3_K_S.gguf +2 -2
  5. gemma-7b-it.Q4_K_M.gguf +2 -2
  6. gemma-7b-it.Q4_K_S.gguf +2 -2
  7. gemma-7b-it.Q5_K_M.gguf +2 -2
  8. gemma-7b-it.Q5_K_S.gguf +2 -2
  9. gemma-7b-it.Q6_K.gguf +2 -2
  10. gemma-7b-it.Q8_0.gguf +2 -2
  11. gemma-7b-it.fp16.gguf +2 -2
gemma-7b-it.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:42da10502fd6ed21f1f12ea89f5ba3af09595cf064280ae7a7c7a20612331446
3
- size 3094507680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80cf76ca4b8dc49fe7eb553fdb8cf817b59155b2e65ca0da39f98733e4d0b35d
3
+ size 3481447424
gemma-7b-it.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24d502df64ae27dc02e44567463184d9a00e433c02c73867dbe653d4dc3ed346
3
- size 4402039968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1507372e8a04bf4b772bab4123213bdd786d83ed7573390ae6f80f02deba7ae
3
+ size 4709067776
gemma-7b-it.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:339f8d1ad6dcea6308310d401cb39b42ce781acd8b31fc65a9d49ee74aae1af1
3
- size 4062301344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cff420b91b4a0f15e4523f1d91f29e30ddaf26ad966a3a8f85b350cc5a356ff4
3
+ size 4369329152
gemma-7b-it.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ccb60c83b6aa7065233dd06f2466461317866de507435c9c4a565607edb8978
3
- size 3675376800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c048daf49075e305957670314a2914a23bc396a840b52e88083cbf88864a0af1
3
+ size 3982404608
gemma-7b-it.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bd87fc03fe3d651ac419ae35f4a0e6d861167db156572b6c4b90fb81822a3547
3
- size 5127231648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcc3a248efa052923be7cdae024f63dfb2623ffd6e73735b1a6684ead653ae82
3
+ size 5329759232
gemma-7b-it.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2b485d0a4e68fcb01a6265b5d1373bcb08f8cc9f27b177add95134bf05fab87
3
- size 4843919520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:235502ec230fd4ae1eb5fcb7ffa1f0e6df24c955ad6206ec540ca4142bd8f67a
3
+ size 5046447104
gemma-7b-it.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:601ea5510042eb36434b85c024f8182350ed9b96b2efeee0157c8035a9042b79
3
- size 6040328352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b04f9d8397f420a6ad34f965cf4950d4c83c4d125ae0e280675015c3c9ca4b8
3
+ size 6144502784
gemma-7b-it.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22d126be2d6a308c9c95dbcc667db20c55ee12cff9eb56529ad680dac94d12bd
3
- size 5876553888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0694074cddc57eda89c56fc25557283edefe99e7479bd26239faa8974a50fa8
3
+ size 5980728320
gemma-7b-it.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:06c44fb30feac4c7d681baf4c68e9d2df45fe624ce22f3a9bad45a8de711dd32
3
- size 7010493600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8641505d635e81b44e40a33e8e49f1953fc825724ab80cb9c28c4eac0bd92c5e
3
+ size 7010167808
gemma-7b-it.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6daf2627518df1d55e8d8c8ca874909cb4f69f4ab863bffc7a0bb7636509bbb6
3
- size 9078266016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbb25e66046bd64d654faab6a215bd543c1f1b0bc288f38a800c82845c0f673d
3
+ size 9077844992
gemma-7b-it.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82ed67cc4c2d9384a67cedd8b07950b71fa06e4a2e0c6ae9cabfad094d67e234
3
- size 34158344288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48527ba79402c0238babcd85db5c2d880c10ff70edde04f3d9f3c25453dd8efd
3
+ size 17081756608