FP16? I can do full quants if you're interested in uploading it
Let me know
Oh, maybe it is already uploaded, here? https://huggingface.co/Heralax/MythoMakise-13b But that's e1, and not sure if that's the same as this?
Anyway let me know if you want me to do quants, and if so which fp16 is most recent
It's an honor to be noticed by TheBloke himself! I'd be very happy for you to quantize my model. I just finished uploading the FP16 file to this repo. Please tell me if it works, I'm 99% sure I used the most recent version of llama.cpp to convert it (spent a lot of yesterday upgrading packages and software versions) but "it works on my machine" is never a guarantee.
This repo, https://huggingface.co/Heralax/MythoMakiseMerged-13b is the correct repo. Don't use https://huggingface.co/Heralax/MythoMakise-13b, that version isn't merged with MythoMax. I really need to get better at organizing my HF repos lol.
Anyway, thanks for coming by, and for all your work in the community!