Exlama2?
Hey,
Are you planning to make an exlama2 version of this one as well? I'd gladly test it.
(GGUF just doesn't work for me)
Thanks.
I don't have a lot of colab credit left, but if I can, I will.
I'm a little reticent to do a lot of EXL2 because it seems that there will be breaking change soon, and I don't really want to requant again.
But I will check if I can!
Thanks! I'll do some research and maybe I can try the conversion on my end locally.
I can do it on my local, so you don't have to waste credits
https://huggingface.co/AzureBlack/U-Amethyst-20B-5bit-exl2
I can do it on my local, so you don't have to waste credits
https://huggingface.co/AzureBlack/U-Amethyst-20B-5bit-exl2
Thank you!
is there actually a better model for RP than this one? because i try lots of recent models, and they are much worse. I know those are obviously censored, but still... Consider this a compliment :)
I don't have a lot of colab credit left, but if I can, I will.
Just out of curiosity, do you use TPU and/or GPU?