TheBloke
/

KAI-7B-Instruct-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

KAI-7B-Instruct-AWQ

1 contributor

History: 8 commits

TheBloke's picture

Update for Transformers AWQ support

d2563d9 about 1 year ago