GGUF Format
Hi, is it official GGUF format ππΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF
Hi, is it official GGUF format ππΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUF
of course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)
Hi, is it official GGUF format ππΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUFof course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)
Thank you for the GGUF format! I am using it
Mantapp
Hi, is it official GGUF format ππΌ..?
https://huggingface.co/gmonsoon/gemma2-9b-cpt-sahabatai-v1-instruct-GGUFof course not, but since there is no official quantized model from GoToCompany, so i'm stepped up and create one (missing some quants model, just because i want to test q2_k, and it's running well)
but, thank you for making it with the GGUF format