mrfakename

/

NeuralOrca-7B-v1

like 5

Hi, I’m not TheBloke but I can provide quantized versions of this model. My upload speed is a bit slow so please let me know what versions of quantized models you want (ie q4_0, q3_K)

That would be great. Could you please upload the Q5_k_m version?

Hi, sorry, my hardware does not support Q5_K_M quantization. Is Q5_0 OK with you?

Yes, the Q5_0 version is suitable too :)

I've just started this and will upload my usual quants over the next hour. Looks like a great model @mrfakename !

Thank you so much @mrfakename for making this great model and thank you @TheBloke for releasing the GGUF versions.