databricks
/

dolly-v2-12b

Text Generation

text-generation-inference

Model card Files Files and versions Community

matthayes commited on Apr 12, 2023

Commit

0a8f92a

•

1 Parent(s): 6b63048

Update README.md

Adjust table formatting

Files changed (1) hide show

README.md +8 -8

README.md CHANGED Viewed

@@ -87,14 +87,14 @@ and in fact underperforms `dolly-v1-6b` in some evaluation benchmarks. We believ
 but a robust statement as to the sources of these variations requires further study.
 ```
-+----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+
-|    | model                              |   openbookqa |   arc_easy |   winogrande |   hellaswag |   arc_challenge |     piqa |    boolq |    gmean |
-|----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------|
-|  2 | EleutherAI/gpt-j-6B                |        0.382 |   0.621633 |     0.651144 |    0.662617 |        0.363481 | 0.761153 | 0.655963 | 0.565936 |
-|  3 | databricks/dolly-v2-12b            |        0.408 |   0.63931  |     0.616417 |    0.707927 |        0.388225 | 0.757889 | 0.568196 | 0.56781  |
-|  4 | databricks/dolly-v1-6b             |        0.41  |   0.62963  |     0.643252 |    0.676758 |        0.384812 | 0.773667 | 0.687768 | 0.583431 |
-|  6 | EleutherAI/gpt-neox-20b            |        0.402 |   0.683923 |     0.656669 |    0.7142   |        0.408703 | 0.784004 | 0.695413 | 0.602236 |
-+----+------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+
 ```
 # Happy Hacking!

 but a robust statement as to the sources of these variations requires further study.
 ```
++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+
+| model                              |   openbookqa |   arc_easy |   winogrande |   hellaswag |   arc_challenge |     piqa |    boolq |    gmean |
++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------|
+| EleutherAI/gpt-j-6B                |        0.382 |   0.621633 |     0.651144 |    0.662617 |        0.363481 | 0.761153 | 0.655963 | 0.565936 |
+| databricks/dolly-v2-12b            |        0.408 |   0.63931  |     0.616417 |    0.707927 |        0.388225 | 0.757889 | 0.568196 | 0.56781  |
+| databricks/dolly-v1-6b             |        0.41  |   0.62963  |     0.643252 |    0.676758 |        0.384812 | 0.773667 | 0.687768 | 0.583431 |
+| EleutherAI/gpt-neox-20b            |        0.402 |   0.683923 |     0.656669 |    0.7142   |        0.408703 | 0.784004 | 0.695413 | 0.602236 |
++------------------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+----------+
 ```
 # Happy Hacking!