Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
conversational
Model card Files Community
26
MaziyarPanahi commited on
Commit
8fe20b7
•
1 Parent(s): 4c8003e

80cbe1cee5ff97c1cbe4bb1429c423879e13d5583f66b84554719db007cff58f

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. imatrix.dat +3 -0
.gitattributes CHANGED
@@ -54,3 +54,4 @@ Meta-Llama-3-70B-Instruct.fp16-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs
54
  Meta-Llama-3-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
55
  Meta-Llama-3-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
  Meta-Llama-3-70B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
 
 
54
  Meta-Llama-3-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
55
  Meta-Llama-3-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
56
  Meta-Llama-3-70B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
57
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6de601a2a16693f6039e6a3662321305e1002d4bebb41d2fa583d0952355a763
3
+ size 24922254