Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Image by ろ47
L3-Umbral-Mind-RP-v1.0-8B-5.3bpw-h6-exl2
This is a 5.3bpw(5.3295) h6 exl2 quant of L3-Umbral-Mind-RP-v1.0-8B
Built-in(default) calibration dataset is used.
- Downloads last month
- 0