Update README.md

README.md

@@ -1,14 +1,73 @@
 ---
 base_model: alpindale/Mistral-7B-v0.2-hf
-tags:
-- generated_from_trainer
-model-index:
-- name: workspace/dolphin-2.8-mistral-7b
-  results: []
+language:
+- en
+license: apache-2.0
+datasets:
+- cognitivecomputations/dolphin
+- cognitivecomputations/dolphin-coder
+- cognitivecomputations/samantha-data
+- jondurbin/airoboros-2.2.1
+- teknium/openhermes-2.5
+- m-a-p/Code-Feedback
+- m-a-p/CodeFeedback-Filtered-Instruction
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
+# Dolphin 2.8 Mistral 7b v0.2 🐬
+
+By Eric Hartford and Cognitive Computations
+
+Discord: https://discord.gg/8fbBeC7ZGx
+
+<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
+
+My appreciation for the sponsors of Dolphin 2.8:
+- [Crusoe Cloud](https://crusoe.ai/) - provided excellent on-demand 10xL40S node
+- [Winston Sou](https://twitter.com/WinsonDabbles) - Along with a generous anonymous sponsor, donated a massive personally owned compute resource!
+- [Abacus AI](https://abacus.ai/) - my employer and partner in many things.
+
+This model is based on [Mistral-7b-v0.2](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf) a new base model released by MistralAI on March 23, 2024 but they have not yet published on HuggingFace.  Thanks to @alpindale for converting / publishing.
+
+The base model has 32k context, and the fine-tune was with 16k sequence lengths.
+
+Dolphin-2.8 has a variety of instruction, conversational, and coding skills.
+
+# Evals
+
+```
+{
+  "arc_challenge": {
+    "acc,none": 0.5921501706484642,
+    "acc_stderr,none": 0.014361097288449701,
+    "acc_norm,none": 0.6339590443686007,
+    "acc_norm_stderr,none": 0.014077223108470139
+  },
+  "gsm8k": {
+    "exact_match,strict-match": 0.4783927217589083,
+    "exact_match_stderr,strict-match": 0.013759618667051773,
+    "exact_match,flexible-extract": 0.5367702805155421,
+    "exact_match_stderr,flexible-extract": 0.013735191956468648
+  },
+  "hellaswag": {
+    "acc,none": 0.6389165504879506,
+    "acc_stderr,none": 0.004793330525656218,
+    "acc_norm,none": 0.8338976299541924,
+    "acc_norm_stderr,none": 0.00371411888431746
+  },
+  "mmlu": {
+    "acc,none": 0.6122347243982339,
+    "acc_stderr,none": 0.003893774654142997
+  },
+  "truthfulqa_mc2": {
+    "acc,none": 0.5189872652778472,
+    "acc_stderr,none": 0.014901128316426086
+  },
+  "winogrande": {
+    "acc,none": 0.7971586424625099,
+    "acc_stderr,none": 0.011301439925936643
+  }
+}
+```
 
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 <details><summary>See axolotl config</summary>