ggml (gguf) CrispEmbed support

#3
by cstr - opened

Very cool model! Thank you for the release and permissive license! We experimentally support it - also quantized - in https://github.com/CrispStrobe/CrispEmbed now, via ggml. We still lack several obvious optimizations yet, and probably there will be errors here or there. So it would be super nice if you could notify about any you encounter.

cstr changed discussion status to closed
cstr changed discussion status to open
BidirLM (Decoder To Encoder) org

Nice initiative, I'll take a look ๐Ÿ™Œ

Nicolas-BZRD changed discussion status to closed

Sign up or log in to comment