This repo seems broken

#3
by FlipProv23 - opened

multiple sets of safe tensors x of 8 and x of 15
4Bit probably should be x of 8 but the proper safe tensors index is also missing

MLX Community org

Thanks!

I will fix it ๐Ÿ‘Œ๐Ÿฝ

MLX Community org

can you try it now?

Looks much better, thanks!
Model, however, doesn't stop producing text despite using the proper prompt template. Maybe I try the instruct version instead.
Thanks again

MLX Community org

Yes, this is the base model.

Itโ€™s suppose to behave that way.

prince-canuma changed discussion status to closed

Sign up or log in to comment