metadata
license: apache-2.0
datasets:
- crumb/textbook-codex
language:
- en
tags:
- cramp
- cramped
distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout
| avg | arc | hellaswag | mmlu | truthfulqa |
|---|---|---|---|---|
| 30.16 | 22.4 | 25.54 | 23.11 | 49.59 |