add readme

README.md

@@ -1,3 +1,42 @@
 ---
 license: apache-2.0
+base_model:
+- nbeerbower/bruphin-epsilon
+- FelixChao/WestSeverus-7B-DPO-v2
+- jondurbin/airoboros-m-7b-3.1.2
+tags:
+- mergekit
+- moe
 ---
+
+# SuperBruphin-3x7B
+
+This is an experimental MoE model created using [mergekit](https://github.com/cg123/mergekit). (mixtral branch)
+
+
+### Models Merged
+
+The following models were included in the merge:
+* [nbeerbower/bruphin-epsilon](https://huggingface.co/nbeerbower/bruphin-epsilon)
+* [FelixChao/WestSeverus-7B-DPO-v2](https://huggingface.co/FelixChao/WestSeverus-7B-DPO-v2)
+* [jondurbin/airoboros-m-7b-3.1.2](https://huggingface.co/jondurbin/airoboros-m-7b-3.1.2)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: nbeerbower/bruphin-epsilon
+gate_mode: hidden
+dtype: bfloat16
+experts:
+  - source_model: nbeerbower/bruphin-epsilon
+    positive_prompts:
+        - "Tell a story."
+  - source_model: FelixChao/WestSeverus-7B-DPO-v2
+    positive_prompts:
+        - "Solve this problem."
+  - source_model: jondurbin/airoboros-m-7b-3.1.2
+    positive_prompts:
+        - "Write a letter."
+```