Also remove the repository if fetch fails