Remove post-install stuff that we no longer need