| license: apache-2.0 | |
| tags: | |
| - merge | |
| - mergekit | |
| - lazymergekit | |
| # Turkish-moe | |
| Turkish-moe is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): | |
| ## 🧩 Configuration | |
| ```yaml | |
| base_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0 | |
| dtype: float16 | |
| gate_mode: cheap_embed | |
| experts: | |
| - source_model: TURKCELL/Turkcell-LLM-7b-v1 | |
| positive_prompts: ["You are an helpful general-pupose assistant."] | |
| - source_model: Trendyol/Trendyol-LLM-7b-chat-dpo-v1.0 | |
| positive_prompts: ["You are helpful assistant."] | |
| ``` |