Sherstnev
/

llama-30b-awq-w4

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

Edit model card

This model was quantized with AWQ algorithm. Intended to use with lmdeploy package.

Downloads last month: 6