mradermacher
/

Llama-3-8B-OPTN-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Jun 20

Commit

3ca34d5

•

1 Parent(s): 4c8e6d2

uploaded from nethype/db1

Files changed (2) hide show

.gitattributes +1 -0
Llama-3-8B-OPTN.Q6_K.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -42,3 +42,4 @@ Llama-3-8B-OPTN.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
 Llama-3-8B-OPTN.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 Llama-3-8B-OPTN.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 Llama-3-8B-OPTN.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text

 Llama-3-8B-OPTN.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 Llama-3-8B-OPTN.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 Llama-3-8B-OPTN.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Llama-3-8B-OPTN.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

Llama-3-8B-OPTN.Q6_K.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3ceac6e21695400fa4cfb98cdd5b9e4a5e13b3831999df709cc9662f097e7de9
+size 6596006656