Don't insert a comment if we are attempting to unfave it