I can see the case for making it less extreme, but it seems a bit odd that a cannibal is as positively influenced by eating human meat as a normal person is in the opposite direction.  I'm thinking the penalty being 2x the bonus is a better way to go, still mulling it over though.