Gemma 2 cencorship

#495
by Someone2077 - opened

I've tested Gemma 2 27b in Google aistudios as well as hugging chat, and it's performance here seems inferior. It's much more cencored and gives poorly formatted, often nonsensical answers.

aistudios: (temperature = 1, Top p = 0.95)
IMG_20240629_025241.jpg

Hugging chat:
IMG_20240629_025543.jpg

Someone2077 changed discussion title from Gemma 2 underperforming to Gemma 2 cencorship
Hugging Chat org

Hi, we have some issue with the implem of Gemma 2 we're working through that negatively affect performance.

HuggingChat is fully open source, with no hidden system prompts for our models (in the case of gemma2 it's no system prompt at all) so model "censorship" is usually not an issue ๐Ÿ˜…

@nsarrazin Thank you for letting me know. Appreciate you working on the performance issue. ๐Ÿ‘

Someone2077 changed discussion status to closed

Sign up or log in to comment