Blackroot
/

Lumimaid-v02-70B-3.8BPW-6H-Exl2

Model card Files Files and versions Community

Lumimaid-v02-70B-3.8BPW-6H-Exl2 / README.md

Blackroot's picture

Update README.md

5ffd0db verified 4 months ago

|

history blame contribute delete

186 Bytes

Quantized version of https://huggingface.co/NeverSleep/Lumimaid-v0.2-70B 3.8 BPW weights with a 6 BPW head

The measurement file is included in case you want to run the quant yourself.