cortecs
/

Smaug-Llama-3-70B-Instruct-GPTQ-4b

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Smaug-Llama-3-70B-Instruct-GPTQ-4b / gptq_model-4bit-128g.safetensors.index.json

Commit History

GPTQ commit model & tokenizer

063f3c0
verified

markoarnauto commited on May 26