Text Generation
Transformers
Safetensors
Chinese
English
llama
conversational
Inference Endpoints
text-generation-inference

GPTQ or AWQ?

#1
by xuchen123 - opened

GPTQ or AWQ?

Owner

currently not available, but gguf is here https://huggingface.co/Azure99/blossom-v5-llama3-8b-gguf/tree/main

Sign up or log in to comment