Text Generation
Transformers
PyTorch
Safetensors
English
llama
conversational
Inference Endpoints
text-generation-inference

awq versions

#4
by KnutJaegersberg - opened

Hey @TheBloke will you quantize those?

Allen Institute for AI org
hamishivi changed discussion status to closed

Sign up or log in to comment