HRuiii
/

Llama-2-7b-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-2-7b-GPTQ-4bit

Commit History

Tokenizer for AutoGPTQ model for meta-llama/Llama-2-7b-hf: 4bits, gr128, desc_act=True

817d529
verified

HRuiii commited on Jul 15

AutoGPTQ model for meta-llama/Llama-2-7b-hf: 4bits, gr128, desc_act=True

33ea5b5
verified

HRuiii commited on Jul 15

initial commit

c80b22b
verified

HRuiii commited on Jul 15