Remove the ability to invite yourself