LoneStriker
/

Yi-6B-200K-4.0bpw-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Yi-6B-200K-4.0bpw-h6-exl2 / model.safetensors.index.json

Commit History

Upload folder using huggingface_hub

da591ef
verified

LoneStriker commited on Mar 16

ExLLaMA V2 quant of Yi-6B-200K-4.0bpw-h6-exl2

9252938

LoneStriker commited on Nov 7, 2023