Create README.md

README.md

@@ -0,0 +1,70 @@
+# Bagel-Hermes-2x34B
+
+This is the model for Bagel-Hermes-2x34B. I used [mergekit](https://github.com/cg123/mergekit) to make this MOE model.
+
+# Prompt Template(s):
+
+Since [bagel-dpo-34b-v0.2](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2) uses many prompt templates, and [Nous-Hermes-2-Yi-34B](https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B) uses ChatML, you can utilize ChatML and other prompt templates provided by bagel.
+
+### ChatML:
+
+```
+<|im_start|>system
+{system}<|im_end|>
+<|im_start|>user
+{user}<|im_end|>
+<|im_start|>assistant
+{asistant}<|im_end|>
+```
+
+### Alpaca (sort of)
+
+```
+Below is an instruction that describes a task.  Write a response that appropriately completes the request.
+
+### Instruction:
+{system}
+{instruction}
+
+### Response:
+```
+### Vicuna
+
+```
+{system}
+USER: {instruction}
+ASSISTANT: 
+```
+
+Visit [bagel-dpo-34b-v0.2](https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2) to try more prompt templates. 
+
+# Yaml Config to reproduce
+
+```yaml
+base_model: nontoxic-bagel-34b-v0.2
+gate_mode: hidden
+dtype: bfloat16
+
+experts:
+  - source_model: bagel-dpo-34b-v0.2
+    positive_prompts: ["question answering", "Q:", science", "biology", "chemistry", "physics"]
+
+  - source_model: Nous-Hermes-2-Yi-34B
+    positive_prompts: ["chat", "math", "reason", "mathematics", "solve", "count", "python", "javascript", "programming", "algorithm", "tell me", "assistant"]
+```
+
+# Quantizationed versions
+
+Quantizationed versions of this model is available thanks to [TheBloke](https://hf.co/TheBloke).
+
+##### GPTQ
+
+- [TheBloke/Bagel-Hermes-2x34B-GPTQ](https://huggingface.co/TheBloke/Bagel-Hermes-2x34B-GPTQ)
+
+##### GGUF
+
+- [TheBloke/Bagel-Hermes-2x34B-GGUF](https://huggingface.co/TheBloke/Bagel-Hermes-2x34B-GGUF)
+
+##### AWQ
+
+- [TheBloke/Bagel-Hermes-2x34B-AWQ](https://huggingface.co/TheBloke/Bagel-Hermes-2x34B-AWQ)