Muennighoff commited on
Commit
ad0c46c
1 Parent(s): bc34f28

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -226,7 +226,7 @@ print(tokenizer.decode(outputs[0]))
226
  ## Hardware
227
 
228
  - **CPUs:** AMD CPUs with 512GB memory per node
229
- - **GPUs:** 288 A100 80GB GPUs (36 nodes) with 8 GPUs per node using NVLink 4 inter-gpu connects, 4 OmniPath links
230
  - **Communication:** NCCL-communications network with a fully dedicated subnet
231
 
232
  ## Software
226
  ## Hardware
227
 
228
  - **CPUs:** AMD CPUs with 512GB memory per node
229
+ - **GPUs:** 288 A100 80GB GPUs with 8 GPUs per node (36 nodes) using NVLink 4 inter-gpu connects, 4 OmniPath links
230
  - **Communication:** NCCL-communications network with a fully dedicated subnet
231
 
232
  ## Software