Anon, could you make same 7B version please?
https://huggingface.co/eachadea/ggml-vicuna-7b-4bit
Thats a ggml version not GPTQ
· Sign up or log in to comment