English
Hrishi commited on
Commit
ea63625
1 Parent(s): 48e8e42

Added README

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: ehartford/dolphin-2.1-mistral-7b
3
+ datasets:
4
+ - ehartford/dolphin
5
+ - jondurbin/airoboros-2.2.1
6
+ language:
7
+ - en
8
+ license: apache-2.0
9
+ model-index:
10
+ - name: mlc-chat-dolphin-2.2.1-mistral-7b
11
+ results: []
12
+ model_creator: Hugging Face H4
13
+ model_name: WASM Dolphin 2.2.1
14
+ model_type: mistral
15
+ prompt_template: '<|im_start|>system
16
+ You are Dolphin, a helpful AI assistant.<|im_end|>
17
+ <|im_start|>user
18
+ {prompt}<|im_end|>
19
+ <|im_start|>assistant'
20
+ ---
21
+
22
+ # Dolphin 2.2.1 (Finetune of Mistral 7B) compiled for WebGPU - q4f32_1
23
+
24
+ - Original model: [Dolphin 2.1 🐬](https://huggingface.co/ehartford/dolphin-2.1-mistral-7b)
25
+ - creator: Eric Hartford: [https://erichartford.com/dolphin](https://erichartford.com/dolphin)
26
+ - compiled by: Hrishi Olickel: [say hi on Twitter!](https://twitter.com/hrishioa)
27
+
28
+ ## Description
29
+
30
+ This is a quantized version of Dolphin 2.1 🐬, one of the best finetunes of [Mistral-7b](https://huggingface.co/mistralai/Mistral-7B-v0.1) out there, ready to be used for on-browser inference over WebGPU.
31
+
32
+ Compiled with [mlc-llm](https://llm.mlc.ai/).
33
+
34
+ Very helpful direction provided by [felladrin](https://github.com/felladrin)!
35
+
36
+ You can use [his example](https://huggingface.co/spaces/Felladrin/Web-LLM-Mistral-7B-OpenOrca) to get quickly started with this model.
37
+
38
+ ## Prompt template: Dolphin
39
+
40
+ Prompt format:
41
+ This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
42
+
43
+ ```
44
+ <|im_start|>system
45
+ You are Dolphin, a helpful AI assistant.<|im_end|>
46
+ <|im_start|>user
47
+ {prompt}<|im_end|>
48
+ <|im_start|>assistant
49
+
50
+ ```
51
+
52
+ Example:
53
+
54
+ ```
55
+ <|im_start|>system
56
+ you are an expert dolphin trainer<|im_end|>
57
+ <|im_start|>user
58
+ What is the best way to train a dolphin to obey me? Please answer step by step.<|im_end|>
59
+ <|im_start|>assistant
60
+ ```