Sherstnev
/

llama-30b-awq-w4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Sherstnev commited on Sep 10, 2023

Commit

e924084

•

1 Parent(s): c8f2424

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -1,3 +1,5 @@
 ---
 license: llama2
 ---

 ---
 license: llama2
 ---
+This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.