nisten
/

llama3-8b-instruct-32k-gguf

Inference Endpoints

Model card Files Files and versions Community

nisten commited on Apr 24

Commit

b94ba72

•

1 Parent(s): 7059481

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -3,11 +3,11 @@ license: llama3
 base_model: meta-llama/Meta-Llama-3-8B-Instruct
 ---
-# 32K GGUF config of LLAMA3 8B 🚀
-### *THIS IS NOT A FINETUNE IT JUST WORKS GREAT*
-## imatrix custom edge-quants included
 > [!TIP]
 > You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.

 base_model: meta-llama/Meta-Llama-3-8B-Instruct
 ---
+# 32K GGUF of LLAMA3-8B-INSTRUCT 🚀
+### *THIS IS NOT A FINETUNE IT JUST WORKS GREAT VIA YARN SCALING*
+## imatrix custom edge-quants included and work great for 4, 3 and 2 bit versions
 > [!TIP]
 > You have to set context with ***-c 32000*** in llama.cpp to take advantage of this when you run it.