Trelis

/

Llama-2-7b-chat-hf-hosted-inference-8bit

like 6

Would like to publish other 8-bit models for use with hosted inference - instructions to reproduce this quantization method would be appreciated.