Sarvam 30b uncensored
#2355
by vasya100 - opened
Uncensored Sarvam 30b, needs quants:
https://huggingface.co/aoxo/sarvam-30b-uncensored/
llama.cpp added support for sarvam-30b in latest releases, so quantizing should work now.
There's not a single gguf of this uncensored model on huggingface made for the latest llama, so if it works, this would be the first working one.
Working Ggufs for censored version of the model already exist https://huggingface.co/Sumitc13/sarvam-30b-GGUF, tested them, they work in latest llama
so this should be possible with uncensored model as well
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#sarvam-30b-uncensored-GGUF for quants to appear.