LoneStriker
/

TinyLlama-1.1B-Chat-v0.3-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

TinyLlama-1.1B-Chat-v0.3-8.0bpw-h8-exl2 / generation_config.json

Commit History

ExLLaMA V2 quant of TinyLlama-1.1B-Chat-v0.3-8.0bpw-h8-exl2

29901b1

LoneStriker commited on Nov 7, 2023