Update README.md
Browse files
README.md
CHANGED
@@ -43,7 +43,7 @@ Evaluation Scores Curve (AVG of scores) during pretraining:
|
|
43 |
|
44 |
For both stats above we don't report CoLA scores as it's pretty unstable. The raw CoLA scores are:
|
45 |
|
46 |
-
|
|
47 |
|----------|----------|----------|----------|----------|----------|----------|----------|----------|
|
48 |
CoLA | 1.7 | 13.5 | 29.2 | 31.4 | 31.1 | 24.1 | 29.0 | 20.0 |
|
49 |
|
|
|
43 |
|
44 |
For both stats above we don't report CoLA scores as it's pretty unstable. The raw CoLA scores are:
|
45 |
|
46 |
+
| Step | 1500 | 3000 | 6000 | 9000 | 13500 | 18000 | 24000 | 30000 |
|
47 |
|----------|----------|----------|----------|----------|----------|----------|----------|----------|
|
48 |
CoLA | 1.7 | 13.5 | 29.2 | 31.4 | 31.1 | 24.1 | 29.0 | 20.0 |
|
49 |
|