Safety checker is way too sensitive

#3
by Krebzonide - opened

I was trying to generate perfectly sfw images, and the safety checker kept on blocking them. I duplicated the space and disabled the safety checker, and the images actually aren’t nsfw at all. I suggest a button in advanced settings to disable the safety checker. I can write the pr myself tomorrow when I have time.

This space:
IMG_3717.jpeg

My space without the safety checker:
IMG_3718.jpeg

As you can see the blocked images were not nsfw and actually nearly identical to the one that it let pass.

Sorry, we have tested the safety checker before and we found that the model can actually sometimes generate the NSFW content without the safety checker. We don't want misusing of the model in this Hugging Face spaces, so we will not disable this sensitive safety checker in this demo spaces. However, users are free to duplicate the space or download the model for their personal use.

SimianLuo changed discussion status to closed

Sign up or log in to comment