LoneStriker
/

Yi-6B-200K-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Yi-6B-200K-8.0bpw-h8-exl2 / output.safetensors

Commit History

ExLLaMA V2 quant of Yi-6B-200K-8.0bpw-h8-exl2

c68be37

LoneStriker commited on Nov 7, 2023