TheBloke
/

orca_mini_v3_70B-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

orca_mini_v3_70B-AWQ

1 contributor

History: 6 commits

TheBloke's picture

Update for Transformers AWQ support

c9fe8bf about 1 year ago