MLX Support

#2906
by JamesPriceSG - opened

I understand your compute and storage challenges and would be interested in assisting, if you have the interest in developing an MLX based versions of these models, we would add them as supported models in our app.

Hi, we are currently doing only gguf

Sign up or log in to comment