Is possible to see a merged Airoboros-33b-SuperHOT-8k without GPTQ?
#1
by
Panchovix
- opened
Thanks for amazing work! I want to do some quantizations variations (like group size 32, 64, 128), act order and such.
But for those, I need the .bin files :(
Thanks!
Yep. Ill upload these.
Panchovix
changed discussion status to
closed