starsy
/

Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

starsy commited on May 17

Commit

1b9637f

•

1 Parent(s): 3a0a499

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ license: llama3
 ---
 # Introduction
-**This is a 4-bit [AWQ](https://github.com/casper-hansen/AutoAWQ) quantized model of [gradientai/Llama-3-70B-Instruct-Gradient-262k](https://huggingface.co/gradientai/Llama-3-70B-Instruct-Gradient-262k).**
 ---

 ---
 # Introduction
+**This is a 4-bit [AWQ(GEMM)](https://github.com/casper-hansen/AutoAWQ) quantized model of [gradientai/Llama-3-70B-Instruct-Gradient-262k](https://huggingface.co/gradientai/Llama-3-70B-Instruct-Gradient-262k).**
 ---