Hugging Face's logo

RichardErkhov
/
abacusai_-_Smaug-Llama-3-70B-Instruct-32K-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
RichardErkhov commited on
Commit
46fb14e
•
1 Parent(s): 641ba0d

uploaded model

Browse files
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00001-of-00002.gguf +3 -0
  3. Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00002-of-00002.gguf +3 -0
.gitattributes CHANGED
@@ -65,3 +65,5 @@ Q5_1/Smaug-Llama-3-70B-Instruct-32K_Q5_1-00001-of-00002.gguf filter=lfs diff=lfs
65
  Q5_1/Smaug-Llama-3-70B-Instruct-32K_Q5_1-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
66
  Q6_K/Smaug-Llama-3-70B-Instruct-32K_Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
67
  Q6_K/Smaug-Llama-3-70B-Instruct-32K_Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
65
  Q5_1/Smaug-Llama-3-70B-Instruct-32K_Q5_1-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
66
  Q6_K/Smaug-Llama-3-70B-Instruct-32K_Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
67
  Q6_K/Smaug-Llama-3-70B-Instruct-32K_Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
68
+ Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00001-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c748b3dc756cfa1b528462f2a94091698379f646336a117f80a87cedbda092b
3
+ size 39808936032
Q8_0/Smaug-Llama-3-70B-Instruct-32K_Q8_0-00002-of-00002.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5415b2f11f6247807204606b977460ea4fc914b2358acd91b821685e5575602c
3
+ size 35166113792