File size: 545 Bytes
30b997b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
---
# Turkish-moe
Turkish-moe is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
## 🧩 Configuration
```yaml
base_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: TURKCELL/Turkcell-LLM-7b-v1
positive_prompts: ["You are an helpful general-pupose assistant."]
- source_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0
positive_prompts: ["You are helpful assistant."]
``` |