q6 and q8 must be better!
#1
by
wukongai
- opened
thanks for your work! wait for q6 & q8 weights.
No problem, I did create but there's a 50GB file limit on Hugging Face.
@senseable can you please share instructions on how did you create them from safetensors model files?
No problem, I did create but there's a 50GB file limit on Hugging Face.
maybe you can split the files to many small files.
Great job! You’ve worked hard! Thank you for your excellent work!
thx @senseable , will try q5_k_m asap