Any plan for a W4A8 version?
#2
by Jellok - opened
Thanks was just wondering if that was in the pipeline. Thank you!
Yes, it was open sourced today and received some testing feedback from group members. I think the model is stable enough and will release other quantitative versions tomorrow.
Looking at the videos looks really good. Fixes some of the pitfalls of H3.
Will you ensure the w4a8 version is still int and convrot?
Thanks Warmblood for taking the time to create the w4a8 model. I am testing it so far I see a great improvement . I use an AMD gpu with 16gig ram it can only do int4 so thank you again!