localmodels
/

baize-v2-7b-4bit

Model card Files Files and versions

baize-v2-7b-4bit / README.md

x0001's picture

Baize V2 7B 4-bit

e7936b7 almost 3 years ago

|

175 Bytes

Baize V2 7B 4-bit

From project-baize: https://huggingface.co/project-baize/baize-v2-7b

Folders

ggml: q4_0 and q4_1

gptq: works with Triton and CUDA branches