Sherstnev
/

llama-30b-awq-w4

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama-30b-awq-w4 / README.md

Sherstnev's picture

Update README.md

e924084 11 months ago

|

history blame contribute delete

No virus

108 Bytes

metadata

license: llama2

This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.