allgather is not done yet.