TariqJamil
/

Llama-2-13b-chat-q4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-2-13b-chat-q4bit / quantize_config.json

Commit History

AutoGPTQ model for meta-llama/Llama-2-13b-chat-hf: 4bits, gr128, desc_act=False

b4736b4

TariqJamil commited on Aug 29, 2023

AutoGPTQ model for meta-llama/Llama-2-13b-chat-hf: 4bits, gr128, desc_act=False

0a638d8

TariqJamil commited on Aug 28, 2023