Create README.md

# Mixture of Expert custom

A mixutre of experts fused with `mergekit` with base model: `mistralai/Mistral-7B-Instruct-v0.2`.

Experts merged with Mistral base model:

- HuggingFaceH4/zephyr-7b-beta
- mistralai/Mistral-7B-Instruct-v0.2
- teknium/OpenHermes-2.5-Mistral-7B
- meta-math/MetaMath-Mistral-7B

README.md

@@ -0,0 +1,8 @@
+---
+license: mit
+library_name: transformers
+tags:
+- mergekit
+- moe
+- mixture of experts
+---