Any int4 version ?

#9
by lucasjin - opened

Any int4 version ?

There is other compression format availbale by TheBloke https://huggingface.co/TheBloke/Nous-Capybara-34B-GGUF

Sign up or log in to comment