Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Model card Files Community
21
MaziyarPanahi commited on
Commit
74a10b3
•
1 Parent(s): af7e1f7

Upload folder using huggingface_hub (#12)

Browse files

- 3f9a0e1012170afbff937e590a596b13583fba5761c77fd5487c20fddec0b0cf (bff7183cfbff44edd8f9fc9aff5ae719a2c2a2c5)
- f9d43ce75cf1827820f718db39aad026cca185b0cf7aa666d38f9b323047ddd3 (946f65ff6dc5a7fd37ad81f6fcd44b6a00a98c0f)
- d3325c874305fbff28df0603097250f5f42da05b0159f0bbb49d370ec2011f81 (f25f0c4a4ec275f7ab58c3563183f7411ce1873d)
- b234f43981883eec8dddb996cf204f92bda1a1c379029b4391cac0df8f79a942 (44db81ea771057fd5d24bc19c40dbe7ace044dfa)
- 3ea1df3a1b5e884b7dc5512b6ab6aee86540ad85ed7e174a3f4e0de5b0480b41 (4c8003eaf4d9a128927abf2d58c786619f7fb056)
- 80cbe1cee5ff97c1cbe4bb1429c423879e13d5583f66b84554719db007cff58f (8fe20b7c7365dcb737fc1399a24419e091e00f61)

Files changed (7) hide show
  1. .gitattributes +4 -0
  2. Meta-Llama-3-70B-Instruct.IQ1_M.gguf +3 -0
  3. Meta-Llama-3-70B-Instruct.IQ1_S.gguf +3 -0
  4. Meta-Llama-3-70B-Instruct.IQ2_XS.gguf +3 -0
  5. Meta-Llama-3-70B-Instruct.IQ3_XS.gguf +3 -0
  6. Meta-Llama-3-70B-Instruct.IQ4_XS.gguf +3 -0
  7. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -51,3 +51,7 @@ Meta-Llama-3-70B-Instruct.fp16-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs
51
  Meta-Llama-3-70B-Instruct.fp16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3-70B-Instruct.fp16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
53
  Meta-Llama-3-70B-Instruct.fp16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
51
  Meta-Llama-3-70B-Instruct.fp16-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3-70B-Instruct.fp16-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
53
  Meta-Llama-3-70B-Instruct.fp16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Meta-Llama-3-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Meta-Llama-3-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Meta-Llama-3-70B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
57
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3-70B-Instruct.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdbe8ac2126a70fa0af3fac7a4fe04f1c76330c50eba8383567587b48b328098
3
+ size 16751708608
Meta-Llama-3-70B-Instruct.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3797a69f1bdf53fabf9f3a3a8c89730b504dd3209406288515c9944c14093048
3
+ size 15343995328
Meta-Llama-3-70B-Instruct.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72dbf29116f12866cf548a48bee4f28cd0535877601b228ce7ce6be36a98bd5f
3
+ size 21142620608
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c4a67096266cbda35ec09af3e6532692c1e267e6f4e8462fcdcefdef873061ec
3
+ size 29308242368
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9532768dca814e8fc61ef27d13f82941199233fdfdf90f1fdcf52be92efe00af
3
+ size 37903174080
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de601a2a16693f6039e6a3662321305e1002d4bebb41d2fa583d0952355a763
3
+ size 24922254