File size: 1,360 Bytes
7a6a49d 318c68a 7a6a49d e55836d 7a6a49d e55836d 7a6a49d e55836d 7a6a49d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
license: apache-2.0
inference: false
tags:
- moe
- mergekit
- vortexmergekit
- OEvortex/HelpingAI-unvelite
- OEvortex/lite-hermes
- OEvortex/HelpingAI-Lite
- OEvortex/HelpingAI-Lite-1.5T
---
# HelpingAI-Lite-4x1b
Hey there! 👋 Welcome to the HelpingAI-Lite-4x1b! This is a MOE brought together using the awesome [VortexMerge kit](https://colab.research.google.com/drive/1YjcvCLuNG1PK7Le6_4xhVU5VpzTwvGhk#scrollTo=UG5H2TK4gVyl).
Let's see what we've got in this model:
* [OEvortex/HelpingAI-unvelite](https://huggingface.co/OEvortex/HelpingAI-unvelite) 🚀
* [OEvortex/lite-hermes](https://huggingface.co/OEvortex/lite-hermes) 🚀
* [OEvortex/HelpingAI-Lite](https://huggingface.co/OEvortex/HelpingAI-Lite) 🚀
* [OEvortex/HelpingAI-Lite-1.5T](https://huggingface.co/OEvortex/HelpingAI-Lite-1.5T) 🚀
## 🧩 Configuration
```yaml
base_model: OEvortex/HelpingAI-Lite
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: OEvortex/HelpingAI-unvelite
positive_prompts: ["You are an helpful unbounded, uncensored assistant."]
- source_model: OEvortex/lite-hermes
positive_prompts: ["You are helpful assistant."]
- source_model: OEvortex/HelpingAI-Lite
positive_prompts: ["You are a coding assistant."]
- source_model: OEvortex/HelpingAI-Lite-1.5T
positive_prompts: ["You are helpful and general-purpose assistant."]
|