---
license: apache-2.0
language:
- en
---
# palmer
This model is a "MErging of Experts" (MEoE) fine-tuned to be biased as an assistant without using any prompts—as a result of these efforts—palmer is better than babbage-002 at most tasks and competitive to qwen-1.8b on most benchmarks despite being 40% smaller.

```
	              MMLU     ARC-C    OBQA   HellaSwag  PIQA  Winogrande Average
tinyllama-chat | 0.2470 | 0.3285 | 0.3740 | 0.6037 | 0.7448 | 0.6022 | 0.4833 |
zyte-1b	       | 0.2397 | 0.3353 | 0.3700 | 0.6086 | 0.7541 | 0.5998 | 0.4845 |
palmer-003     | 0.2534 | 0.3370 | 0.3740 | 0.6128 | 0.7486 | 0.6535 | 0.4965 |
qwen-1-8       | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 |
```

This work constitutes an advancement towards SMLs being easily powered by edge devices like mobile phones, raspberry pis and automated software/robots. Aditionally, palmer-003 deviates its main philosophy from palmer-family to become a more powerful model with more data instead of less.

Note that since this is a traditional transformer as any popular language model, it contains hallucinations (make mistakes), and as such, it must be used with precaution on sensitive tasks.

**Prompt test**

what is reality?

The question of what is reality is a fundamental one that has been debated for centuries. There are many different views on this topic, and each person's perspective may be influenced by their beliefs, experiences, and cultural background.

One common view is that reality is a subjective experience, shaped by our perceptions and experiences. This view is often referred to as the "subjective view" or the "phenomenal view." According to this view, reality is not objective, but rather a product of our perceptions and experiences.