Hugging Face's logo

tetraturtle
/
G4-LuneLight-31B-exl3

exl3
Model card Files
xet
 Community

G4 / LuneLight-31B

QUANTIZED BY: USER
Information
exl3 quantizations of LuneLight-31B via exllamav3.
repo generated automatically with ezexl3.
Repo Data
Mean KL divergence vs bits per weight Perplexity vs bits per weight Per-token KL divergence distribution Combined per-token KL divergence distributions and noise floor
REVISION GiB
3.00bpw 14.29
3.10bpw 14.63
3.25bpw 15.14
6.00bpw 24.52
bf16 58.25
CLI Download
hf download USER/LuneLight-31B-exl3 --revision "3.00bpw" --local-dir ./LuneLight-31B-exl3-3.00bpw
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support