Edit model card

Dolphin 2.0 🐬 https://erichartford.com/dolphin

Dolphin-2.0-mistral-7b's training was sponsored by a16z.

This model is based on mistralAI, so it is suitable for commercial or non-commercial use.

This model is uncensored. I have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant to any requests, even unethical ones. Please read my blog post about uncensored models. https://erichartford.com/uncensored-models You are responsible for any content you create using this model. Enjoy responsibly.

Dataset

This dataset is Dolphin, an open-source implementation of Microsoft's Orca

I modified the dataset for uncensoring, deduping, cleaning, and quality.

I added Jon Durbin's excellent Airoboros dataset to increase creativity.

Training

It took 48 hours to train 10 epochs on 4x A100s.

Prompt format: This model (and all my future releases) use ChatML prompt format.

<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>

Example:

<|im_start|>system
you are an expert dolphin trainer<|im_end|>
<|im_start|>user
What is the best way to train a dolphin to obey me?  Please answer step by step.<|im_end|>

Gratitude

  • This model was made possible by the generous sponsorship of a16z.
  • Thank you to Microsoft for authoring the Orca paper and inspiring this work.
  • Special thanks to WingLian, and TheBloke for helpful advice
  • Thank you to all the other people in the Open Source AI community who have taught me and helped me along the way.

Example Output

image/png

Buy me a coffee

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 55.85
ARC (25-shot) 59.22
HellaSwag (10-shot) 80.26
MMLU (5-shot) 56.9
TruthfulQA (0-shot) 61.09
Winogrande (5-shot) 75.37
GSM8K (5-shot) 18.65
DROP (3-shot) 39.49

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 58.58
AI2 Reasoning Challenge (25-Shot) 59.22
HellaSwag (10-Shot) 80.26
MMLU (5-Shot) 56.90
TruthfulQA (0-shot) 61.09
Winogrande (5-shot) 75.37
GSM8k (5-shot) 18.65
Downloads last month
1,570

Datasets used to train cognitivecomputations/dolphin-2.0-mistral-7b

Spaces using cognitivecomputations/dolphin-2.0-mistral-7b 12

Evaluation results