flozi00
/

Llama-2-13b-german-assistant-v6-4bit-autogptq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-2-13b-german-assistant-v6-4bit-autogptq / quantize_config.json

Commit History

Update quantize_config.json

6af4db3

flozi00 commited on Aug 23, 2023

Upload of AutoGPTQ quantized model

b881eda

flozi00 commited on Aug 21, 2023