Hugging Face's logo

IHaveNoClueAndIMustPost
/
Llama-3-11.5B-Instruct-v2_GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
IHaveNoClueAndIMustPost commited on
Commit
eb8104f
•
1 Parent(s): a3f2c2f

Upload 2 files

Browse files

Requantized with llama.cpp commit [b2710](https://github.com/ggerganov/llama.cpp/releases/tag/b2710). Uploaded correct versions this time.

Files changed (3) hide show
  1. .gitattributes +1 -0
  2. Replete-AI_Llama-3-11.5B-Instruct-v2-Q4_M.gguf +3 -0
  3. Replete-AI_Llama-3-11.5B-Instruct-v2-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -35,3 +35,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Replete-AI_Llama-3-11.5B-Instruct-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
  Replete-AI_Llama-3-11.5B-Instruct-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Replete-AI_Llama-3-11.5B-Instruct-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
  Replete-AI_Llama-3-11.5B-Instruct-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Replete-AI_Llama-3-11.5B-Instruct-v2-Q4_M.gguf filter=lfs diff=lfs merge=lfs -text
Replete-AI_Llama-3-11.5B-Instruct-v2-Q4_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e05b1b1799ca6ea3f5f9add7b1531421786c80a5d178e3f6d8013b05d9e09531
3
+ size 7014475392
Replete-AI_Llama-3-11.5B-Instruct-v2-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eaabf6c9af63f3fb52c136e5ce4c1f0bd2c5681a5fc757a10278b27edbc2a00a
3
+ size 9459664512