5 quants?

#1
by Orenguteng - opened

Possible please?

How are you going to run an unsupported model?

Oh didnt see it was unsupported

Orenguteng changed discussion status to closed

Ouch I've exactly tried to run it with LM-Studio and it failed ✌️

I want to use llamacpp for starcoder model however it throws error for starcoder2, is it not supported by llamacpp python?

@madhucharan You need to check if the version of llamacpp python you are using is running a commit after they added support.

Sign up or log in to comment