Update README.md
Browse files
README.md
CHANGED
|
@@ -17,6 +17,7 @@ Note: Sequence length warmup was not used to move up from 2048 but, in hindsight
|
|
| 17 |
|
| 18 |
```yaml
|
| 19 |
{
|
|
|
|
| 20 |
"eval_batch_size": 2,
|
| 21 |
|
| 22 |
"pipe-parallel-size": 1,
|
|
|
|
| 17 |
|
| 18 |
```yaml
|
| 19 |
{
|
| 20 |
+
# 8 Nodes 8xA100 40GB
|
| 21 |
"eval_batch_size": 2,
|
| 22 |
|
| 23 |
"pipe-parallel-size": 1,
|