Attempts to fill out the 1B3 model details that diverge from the main one.

#1
by meg HF staff - opened
BigScience Workshop org

@meg It all looks great but I think we will have to update the hardware information. If I'm not mistaken, V100s will either have 16GB or 32GB of memory; and I think it should be 64 of them (16 nodes, each with 4 GPUs).

@teven How much memory did the GPUs have?

meg changed pull request status to merged

Sign up or log in to comment