mistralai

/

Mistral-7B-Instruct-v0.2

like 2.38k

does for me. EDIT: GGUF version does. Not tried it native. - EDIT 2: A bit slower than GGUF on same hardware, but ya, it worked.

I wrote a simple wrapper CLI if anyone wants to try the GGUF version on CPU :)

You can work native as well it's just a model supported by transformers