johannhartmann
commited on
Commit
•
6a8d81b
1
Parent(s):
ded1b7f
Update README.md
Browse files
README.md
CHANGED
@@ -19,7 +19,25 @@ pipeline_tag: text-generation
|
|
19 |
This is a dpo aligned merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
20 |
|
21 |
## Benchmarks
|
|
|
|
|
22 |
```json
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
```
|
24 |
|
25 |
## Merge Details
|
|
|
19 |
This is a dpo aligned merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
20 |
|
21 |
## Benchmarks
|
22 |
+
|
23 |
+
This was expected to be better :-). Need to have a look why.
|
24 |
```json
|
25 |
+
{
|
26 |
+
"first_turn": 6.35,
|
27 |
+
"second_turn": 6.45625,
|
28 |
+
"categories": {
|
29 |
+
"writing": 7.725,
|
30 |
+
"roleplay": 7.875,
|
31 |
+
"reasoning": 4,
|
32 |
+
"math": 3.8,
|
33 |
+
"coding": 4.05,
|
34 |
+
"extraction": 7.0,
|
35 |
+
"stem": 8.5,
|
36 |
+
"humanities": 8.275
|
37 |
+
},
|
38 |
+
"average": 6.403124999999999
|
39 |
+
}
|
40 |
+
|
41 |
```
|
42 |
|
43 |
## Merge Details
|