Don't try to remove an edge that doesn't exists