maitreyaz
/

Llama-3-8B-AWQ-4bit

Text Generation

Inference Endpoints

text-generation-inference

4-bit precision

Model card Files Files and versions Community

maitreyaz commited on Apr 29

Commit

b778999

•

1 Parent(s): 536adde

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -4,4 +4,5 @@ language:
 - en
 ---
-# Llama3 AWQ Quantized

 - en
 ---
+# Llama 3 8B AWQ 4-bit Quantized
+- This is an AWQ 4-bit Quantized version of Meta's Llama 3 8B.