TheBloke
/

open-llama-7B-v2-open-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

open-llama-7B-v2-open-instruct-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support

0b030a3

TheBloke commited on Aug 21, 2023

Initial GPTQ model commit

4c85992

TheBloke commited on Jul 11, 2023