altomek
/

Higgs-Llama-3-70B-4bpw-EXL2

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

Higgs-Llama-3-70B

ExLlamav2 4 bpw 8 hb quants of https://huggingface.co/bosonai/Higgs-Llama-3-70B

Downloads last month: 7

Inference API

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/Higgs-Llama-3-70B-4bpw-EXL2

Base model

meta-llama/Meta-Llama-3-70B

Finetuned

bosonai/Higgs-Llama-3-70B

Quantized

this model