leo-pekelis-gradient commited on
Commit
d18ddbb
1 Parent(s): 7bf2aa3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -44,7 +44,7 @@ For training data, we generate long contexts by augmenting [SlimPajama](https://
44
  | Steps | 30 | 24 |
45
  | Total Tokens | 63 M | 101 M |
46
  | Learning Rate | 2.00E-05 | 2.00E-05 |
47
- | # GPUs | 32 | 32 |
48
  | GPU Type | NVIDIA L40S | NVIDIA L40S|
49
 
50
  ## The Gradient AI Team
 
44
  | Steps | 30 | 24 |
45
  | Total Tokens | 63 M | 101 M |
46
  | Learning Rate | 2.00E-05 | 2.00E-05 |
47
+ | # GPUs | 8 | 32 |
48
  | GPU Type | NVIDIA L40S | NVIDIA L40S|
49
 
50
  ## The Gradient AI Team