gguf quantization

#3
by rzabounidis - opened

Since this is a llava-next model, are there plans to support quanitzation?

Sign up or log in to comment