TheBloke
/

koala-7B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

koala-7B-GPTQ / params.json

TheBloke's picture

Add JSON files

cda25b1 about 1 year ago

raw history blame contribute delete

No virus

101 Bytes

{"dim": 4096, "multiple_of": 256, "n_heads": 32, "n_layers": 32, "norm_eps": 1e-06, "vocab_size": -1}