Helps if we stop trying to build the package we just removed