Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Model card Files Community
24

Upload folder using huggingface_hub

#19
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/19
Discussion Files changed
+13
-13
Files changed (13) hide show
  1. Meta-Llama-3-70B-Instruct.IQ2_XS.gguf +1 -1
  2. Meta-Llama-3-70B-Instruct.IQ3_XS.gguf +1 -1
  3. Meta-Llama-3-70B-Instruct.IQ4_XS.gguf +1 -1
  4. Meta-Llama-3-70B-Instruct.Q2_K.gguf +1 -1
  5. Meta-Llama-3-70B-Instruct.Q3_K_L.gguf +1 -1
  6. Meta-Llama-3-70B-Instruct.Q3_K_M.gguf +1 -1
  7. Meta-Llama-3-70B-Instruct.Q3_K_S.gguf +1 -1
  8. Meta-Llama-3-70B-Instruct.Q4_K_M.gguf +1 -1
  9. Meta-Llama-3-70B-Instruct.Q4_K_S.gguf +1 -1
  10. Meta-Llama-3-70B-Instruct.Q5_K_M.gguf +1 -1
  11. Meta-Llama-3-70B-Instruct.Q5_K_S.gguf +1 -1
  12. Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf +1 -1
  13. Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf +1 -1
Meta-Llama-3-70B-Instruct.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72dbf29116f12866cf548a48bee4f28cd0535877601b228ce7ce6be36a98bd5f
3
  size 21142620608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30439325ad435cb4eb1cdaad4cfb6d8e446f08de6072d64e3358c7aaa3a1e391
3
  size 21142620608
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4a67096266cbda35ec09af3e6532692c1e267e6f4e8462fcdcefdef873061ec
3
  size 29308242368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:011bb64f742b177eb0f0291c7945536f27147efa5c997c0e93ab48c420f78f71
3
  size 29308242368
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9532768dca814e8fc61ef27d13f82941199233fdfdf90f1fdcf52be92efe00af
3
  size 37903174080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d23d43e8be1a8a3e3592562d472be46a7ec230108eab3ccd5a4f104b7d73c35
3
  size 37903174080
Meta-Llama-3-70B-Instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bab2026b5859a14f59463b3202517aff81a015e7ac60b78322a3895e005e00ec
3
  size 26375621056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcf2b2c404c32e65406767ace3bf87b7ea287e6db7ffa7e39860b2ca7d3f050c
3
  size 26375621056
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4708ba46764811fe3c9454598282197787ba01bdb745a15b878df52c12e12067
3
  size 37141105088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3543ca063726839d98a816b523f55c25e526e19db8461475b82b80f0b2cc8d99
3
  size 37141105088
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffc76ff74022adb94c91442a6eea9a19d3f3568afdc79f03b82b848ff32d81a8
3
  size 34268006848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b542dbf27a1596bcd86f881406b701eef8ca2b774483810ac5959e60477acb64
3
  size 34268006848
Meta-Llama-3-70B-Instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:19f7db516cd41c2c74a686118655cfa71f0a910fa108328497b11ee789954aa5
3
  size 30912563648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b84a9c9dc7515629751f73ab59705721b28492a66b3652db95c8420b6a997da7
3
  size 30912563648
Meta-Llama-3-70B-Instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d559de8dd806a76dbd29f8d8bd04666f2b29e7c7872d8e8481abd07805884d72
3
  size 42520906176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1cea5f87dc1af521f31b30991a4663e7e43f6046a7628b854c155f489eec213
3
  size 42520906176
Meta-Llama-3-70B-Instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a571f8ad70be74c3546458b1bb49e7a9c4b7cfcad30434ecd1ec94ae899bbb8
3
  size 40347732416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:291bab7a614db2be875d1cc35e2b9d33459287031074ddec52564fa1b0fc3c68
3
  size 40347732416
Meta-Llama-3-70B-Instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:739d526b7a25cb2ede7b16df07598332b78b32a02fe1c6b092e0f1859c388324
3
  size 49950329280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08bdfd51ac339a1a5ac4169679ff4e52fbe18232e3f21e556ab9c8e7faf5f8fa
3
  size 49950329280
Meta-Llama-3-70B-Instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0820e87b846d57b6657a6c454da164255cc223c312fe6ea499b4e71274453750
3
  size 48657959360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d43782228a306d1ae0e1f2cde13e5e8a8c55885e8a7454b037564167a2b7fedb
3
  size 48657959360
Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:795750a19853864ef4c067f453b1fbbc41f6c08eec28d485314403f62d2447ee
3
  size 32141688512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e7691f0e569edca2b5f032352fce7ac9edd2cb57a87185c9b8c269ba3d72ade
3
  size 32141688512
Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:133f7e86c672175d2bacd016a2056d125cbfd08b57a23e76565eef1db21e6bc6
3
  size 39759237056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac1197fc440eef5913b169048abf8bea35520df637433e45959649e6e94ab015
3
  size 39759237056