Update README.md
Browse files
README.md
CHANGED
@@ -16,15 +16,15 @@ The resulting model achieves a puplexity of 339.38, making it competative with C
|
|
16 |
|
17 |
### Evaluation of GPT2023
|
18 |
|
19 |
-
| model | piqa acc | winogrande acc | lambada ppl | lambada acc | arc acc |
|
20 |
-
| --- | --- | --- | --- | --- | --- |
|
21 |
-
| pythia-70m | 59.85 | 51.22 | 140.81 | 21.40 | 17.15 |
|
22 |
-
| pythia-160m | 62.68 | 51.07 | 30.03 | 36.76 | 19.62 |
|
23 |
-
| pythia-410m | 66.54 | 52.24 | 11.75 | 49.93 | 21.67 |
|
24 |
-
| opt-125m | 63.00 | 50.27 | 26.02 | 37.90 | 18.94 |
|
25 |
-
| --- | --- | --- | --- | --- | --- |
|
26 |
-
| gpt2 (124m) | **62.89** | **51.61** | 40.06 | 32.56 | **19.03** |
|
27 |
-
| **gpt2023** (124m) | 62.02 | 49.64 | **34.55** | **33.98** | 18.94 |
|
28 |
|
29 |
|
30 |
### Model description
|
|
|
16 |
|
17 |
### Evaluation of GPT2023
|
18 |
|
19 |
+
| model | piqa acc | winogrande acc | lambada ppl | lambada acc | arc acc | sciq acc | wsc acc |
|
20 |
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
21 |
+
| pythia-70m | 59.85 | 51.22 | 140.81 | 21.40 | 17.15 | 65.00 | 36.53 |
|
22 |
+
| pythia-160m | 62.68 | 51.07 | 30.03 | 36.76 | 19.62 | 76.20 | 36.58 |
|
23 |
+
| pythia-410m | 66.54 | 52.24 | 11.75 | 49.93 | 21.67 | 80.80 | 60.58 |
|
24 |
+
| opt-125m | 63.00 | 50.27 | 26.02 | 37.90 | 18.94 | 75.1 | 36.54 |
|
25 |
+
| --- | --- | --- | --- | --- | --- | --- | --- |
|
26 |
+
| gpt2 (124m) | **62.89** | **51.61** | 40.06 | 32.56 | **19.03** | 75 | **43.27** |
|
27 |
+
| **gpt2023** (124m) | 62.02 | 49.64 | **34.55** | **33.98** | 18.94 | **76.1** | 36.54 |
|
28 |
|
29 |
|
30 |
### Model description
|