Hugging Face's logo

crusoeai
/
Llama-3-70B-Instruct-Gradient-262k-GGUF

GGUF
Model card Files Community
2

Q6 & Q8

#1
by bigstorm - opened
Discussion
bigstorm

Good afternoon,

Thank you for your contributions to gradients compute, and creating these models.

Is there a reason you did not produce Q6 and Q8 versions? Thanks!

3thn
 Crusoe AI org

Hey @bigstorm - I'll upload those, at the time of these generations I didn't have gguf-split set up for files over the HF 50GB limit. But I do now! :D

bigstorm

You're the best. Thank you so much! I'll check back this afternoon and see if they made it on. My 3090s are already smiling. :D

3thn
 Crusoe AI org

@bigstorm all uploaded, enjoy!

3thn changed discussion status to closed

Sign up or log in to comment