File size: 301 Bytes
01dd181 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
license: apache-2.0
datasets:
- crumb/textbook-codex
language:
- en
tags:
- cramp
- cramped
---
distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout
| avg | arc | hellaswag | mmlu | truthfulqa |
| --- | --- | --- | --- | --- |
| 30.16 | 22.4 | 25.54 | 23.11 | 49.59 | |