Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
conversational
Model card Files Community
26
MaziyarPanahi commited on
Commit
291ece2
•
1 Parent(s): 74a10b3

Upload folder using huggingface_hub (#19)

Browse files

- 3f9a0e1012170afbff937e590a596b13583fba5761c77fd5487c20fddec0b0cf (a3cd33180b939f98cdd1b6cd7bd87067e3a8c197)
- f9d43ce75cf1827820f718db39aad026cca185b0cf7aa666d38f9b323047ddd3 (3610def5f1baf90e1c89dc05d9219dddd0fb6815)
- 87af93dc0d4adb1ea6e9e3854e6fb28fccb0f31261e2ffa7e9aefcdb442d7284 (5fc426822bbd0bdafae470bbbae112c3067ff230)
- ddd7a33f19d2a33dfcbfa7dcefafa0e3e4cfe762ed656813ee8fa3934914c066 (9692e0e44c5538bc551b904b23789c6102fd39e3)
- dc4f64b05b11a1d6c02ce81b1ea6322bf65848b8b76a6f8f439b8f549ae0e5a8 (655d13de34be2f033440e90e5ea8f29c8c3ee724)
- 7a493f35f393056ea7d332173727474e9e387303cac35be9e7b86194d050a938 (aac836fab2032ec88b02cbd08611eff35825d6a4)
- e49b01887f64a3e3edce18b0985c1ed5dd2f1a6f1d309f27a0bfcc4f27bcc154 (6627e4bd90fa815f704c79d1191299006a9efe34)
- de27614e8263fc0e77b7770fa476731d483e43e2d2fb3e7c1dff96fd3c766a7f (22bbf00e206b3fc71024ee8540cf9251c0fac24c)
- d6007aefcfeb84787299017dcccaadcfb736ccd3c90e3fb1fbd659e1d86b79b5 (4a89b44e95673a76b50c7766b091f2b74fe1e5ee)
- 7012003d31f7c17036b282667b1746a22d0f875d84085bace5705869668bdf67 (8578fadcdea3054cbff6828d9d067ca82ec55116)
- 4b144f047c802cca811247895c3e37bfce3c3d266d1b40d92c035744bc1b0d83 (4522210b4901df93c2c08f04e6f28a542a69e7da)
- 2caaa2f8fa499e954c564a923b22355823a46911723b33cddf43331c568a4111 (7d6a88a7b838b879b98890c672bb41538de3e176)
- 646a30e0f38d05a5452dcf7d9726118bc3effe6e1595a46857c9a8fb09c6512a (634aa0cd7575546a810cae2682f278f029eb2148)
- cc446a364c77bd14ea211e2eaaae462f8efe83c4e9448c72c112ac5c26db03ab (588f818c369c2ba4030534c07f2af02566d41b5e)
- 00bb799203e46b23da18b1f29932691a62765ff80513b008811be068f5513db0 (e2eefc3591c7fd5129f95d710d2a612a07b42856)
- db3fdfadbd57a1f6840f76ace90cf19f276f89d93116029b4f279ff7cef7a240 (5916c7893643f7cdc5b2bfa25177148d92b7e914)
- fa3271d3236de8cfff8e28202210deaf5e4a5131071fb49b2b0649a9a4ea3b61 (196e6f02ccb50a9ee4eee5261bc13c984dd3b1df)
- 4d4e9c3d78e0c44e9ab1b3199c78fce60433d6c54c5ce1e4162c668312439eb1 (c5f46b39aa815e88b155661acfaf48b9f979c783)
- cb1aeba59f5b31fbbf867ff4a28b29e9451fd787074411f47186de467268825a (9f36c97f655da1bb863de871b7ff4dc75b6475f6)
- 8b236fb284b0ac18c7d5bd26bc563f704a878a5c7efaabe034d12fd44db19094 (8f5e4f13b56a2845c392013904204d053fde07c1)
- 3eaba7fac4993cd4307b536ded6c60259f2addf2a3755b28ede41e07b8d90e34 (9810b1dedf04087594188cbf53e5aae395a1e3ae)

Files changed (13) hide show
  1. Meta-Llama-3-70B-Instruct.IQ2_XS.gguf +1 -1
  2. Meta-Llama-3-70B-Instruct.IQ3_XS.gguf +1 -1
  3. Meta-Llama-3-70B-Instruct.IQ4_XS.gguf +1 -1
  4. Meta-Llama-3-70B-Instruct.Q2_K.gguf +1 -1
  5. Meta-Llama-3-70B-Instruct.Q3_K_L.gguf +1 -1
  6. Meta-Llama-3-70B-Instruct.Q3_K_M.gguf +1 -1
  7. Meta-Llama-3-70B-Instruct.Q3_K_S.gguf +1 -1
  8. Meta-Llama-3-70B-Instruct.Q4_K_M.gguf +1 -1
  9. Meta-Llama-3-70B-Instruct.Q4_K_S.gguf +1 -1
  10. Meta-Llama-3-70B-Instruct.Q5_K_M.gguf +1 -1
  11. Meta-Llama-3-70B-Instruct.Q5_K_S.gguf +1 -1
  12. Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf +1 -1
  13. Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf +1 -1
Meta-Llama-3-70B-Instruct.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:72dbf29116f12866cf548a48bee4f28cd0535877601b228ce7ce6be36a98bd5f
3
  size 21142620608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30439325ad435cb4eb1cdaad4cfb6d8e446f08de6072d64e3358c7aaa3a1e391
3
  size 21142620608
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c4a67096266cbda35ec09af3e6532692c1e267e6f4e8462fcdcefdef873061ec
3
  size 29308242368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:011bb64f742b177eb0f0291c7945536f27147efa5c997c0e93ab48c420f78f71
3
  size 29308242368
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9532768dca814e8fc61ef27d13f82941199233fdfdf90f1fdcf52be92efe00af
3
  size 37903174080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6d23d43e8be1a8a3e3592562d472be46a7ec230108eab3ccd5a4f104b7d73c35
3
  size 37903174080
Meta-Llama-3-70B-Instruct.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bab2026b5859a14f59463b3202517aff81a015e7ac60b78322a3895e005e00ec
3
  size 26375621056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcf2b2c404c32e65406767ace3bf87b7ea287e6db7ffa7e39860b2ca7d3f050c
3
  size 26375621056
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4708ba46764811fe3c9454598282197787ba01bdb745a15b878df52c12e12067
3
  size 37141105088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3543ca063726839d98a816b523f55c25e526e19db8461475b82b80f0b2cc8d99
3
  size 37141105088
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffc76ff74022adb94c91442a6eea9a19d3f3568afdc79f03b82b848ff32d81a8
3
  size 34268006848
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b542dbf27a1596bcd86f881406b701eef8ca2b774483810ac5959e60477acb64
3
  size 34268006848
Meta-Llama-3-70B-Instruct.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:19f7db516cd41c2c74a686118655cfa71f0a910fa108328497b11ee789954aa5
3
  size 30912563648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b84a9c9dc7515629751f73ab59705721b28492a66b3652db95c8420b6a997da7
3
  size 30912563648
Meta-Llama-3-70B-Instruct.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d559de8dd806a76dbd29f8d8bd04666f2b29e7c7872d8e8481abd07805884d72
3
  size 42520906176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1cea5f87dc1af521f31b30991a4663e7e43f6046a7628b854c155f489eec213
3
  size 42520906176
Meta-Llama-3-70B-Instruct.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a571f8ad70be74c3546458b1bb49e7a9c4b7cfcad30434ecd1ec94ae899bbb8
3
  size 40347732416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:291bab7a614db2be875d1cc35e2b9d33459287031074ddec52564fa1b0fc3c68
3
  size 40347732416
Meta-Llama-3-70B-Instruct.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:739d526b7a25cb2ede7b16df07598332b78b32a02fe1c6b092e0f1859c388324
3
  size 49950329280
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08bdfd51ac339a1a5ac4169679ff4e52fbe18232e3f21e556ab9c8e7faf5f8fa
3
  size 49950329280
Meta-Llama-3-70B-Instruct.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0820e87b846d57b6657a6c454da164255cc223c312fe6ea499b4e71274453750
3
  size 48657959360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d43782228a306d1ae0e1f2cde13e5e8a8c55885e8a7454b037564167a2b7fedb
3
  size 48657959360
Meta-Llama-3-70B-Instruct.Q6_K-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:795750a19853864ef4c067f453b1fbbc41f6c08eec28d485314403f62d2447ee
3
  size 32141688512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e7691f0e569edca2b5f032352fce7ac9edd2cb57a87185c9b8c269ba3d72ade
3
  size 32141688512
Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:133f7e86c672175d2bacd016a2056d125cbfd08b57a23e76565eef1db21e6bc6
3
  size 39759237056
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac1197fc440eef5913b169048abf8bea35520df637433e45959649e6e94ab015
3
  size 39759237056