Fix issues with setting and clearing followers.