Make sure that su/busybox symlinks we're adding are preserved during removing invalid ones