Creating more versions of Mixtral

#1
by jkepler81 - opened

Hello,

Excellent work. I would like to know if you could provide a step-by-step guide to create more versions of Mixtral using your quantized method. I want to test with the mixtral-dolphin version.

Best

Likewise! I am very happy with this model and would like to contribute GPU toward other models being quantized in this way! :D

This comment has been hidden

Sign up or log in to comment