|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
- es |
|
- fr |
|
tags: |
|
- merge |
|
--- |
|
 |
|
|
|
palmer-003 is appvoid's lastest effort into creating the best small, general language model possible. |
|
|
|
``` |
|
Query: Your instruction |
|
|
|
Answer: |
|
``` |
|
|
|
**Evaluation** |
|
``` |
|
Model MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average Params |
|
tinyllama-3t | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B | |
|
zyte-1b | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 | 1.1B | |
|
palmer-003 | 0.2523 | 0.3439 | 0.3740 | 0.6208 | 0.7524 | 0.6590 | 0.5004 | 1.1B | |
|
qwen-1.8b | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B | |
|
``` |
|
|
|
You can support me [through kofi](https://ko-fi.com/appvoid). |
