Handle removals on the updater repo