TheBloke
/

Llama-2-70B-Chat-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Llama-2-70B-Chat-GPTQ / config.json

Commit History

Update config.json

ed7a25b

TheBloke commited on Aug 20, 2023

Update for Transformers GPTQ support

282db5e

TheBloke commited on Aug 20, 2023

Initial GPTQ model commit

1d82368

TheBloke commited on Jul 19, 2023