appvoid/palmer-003

palmer-003 is appvoid's lastest effort into creating the best small, general language model possible.

Query: Your instruction

Answer:

Evaluation

  Model         MMLU     ARC-C    OBQA   HellaSwag  PIQA  Winogrande Average  Params
tinyllama-3t | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B  |
zyte-1b	     | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 | 1.1B  |
palmer-003   | 0.2523 | 0.3439 | 0.3740 | 0.6208 | 0.7524 | 0.6590 | 0.5004 | 1.1B  |
qwen-1.8b    | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B  |

You can support me through kofi.