TheBloke
/

Upstage-Llama-2-70B-instruct-v2-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Upstage-Llama-2-70B-instruct-v2-AWQ / quant_config.json

Commit History

AWQ model commit

35154c0

TheBloke commited on Sep 19, 2023