TheBloke
/

Llama-2-70B-Chat-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama-2-70B-Chat-AWQ / config.json

Commit History

Update for Transformers AWQ support

55c2786

TheBloke commited on Nov 9, 2023

AWQ model commit

7e5e589

TheBloke commited on Sep 19, 2023