Quantized GGUF models

#1
by bullerwins - opened

Hi!

If anyone wants to use the GGUF quantized version to use with llama.cpp I have uploaded them here:

https://huggingface.co/bullerwins/Athene-70B-GGUF

Sign up or log in to comment