Allow hosts to be removed even if they don't exist