Hrishi
commited on
Commit
•
ea63625
1
Parent(s):
48e8e42
Added README
Browse files
README.md
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: ehartford/dolphin-2.1-mistral-7b
|
3 |
+
datasets:
|
4 |
+
- ehartford/dolphin
|
5 |
+
- jondurbin/airoboros-2.2.1
|
6 |
+
language:
|
7 |
+
- en
|
8 |
+
license: apache-2.0
|
9 |
+
model-index:
|
10 |
+
- name: mlc-chat-dolphin-2.2.1-mistral-7b
|
11 |
+
results: []
|
12 |
+
model_creator: Hugging Face H4
|
13 |
+
model_name: WASM Dolphin 2.2.1
|
14 |
+
model_type: mistral
|
15 |
+
prompt_template: '<|im_start|>system
|
16 |
+
You are Dolphin, a helpful AI assistant.<|im_end|>
|
17 |
+
<|im_start|>user
|
18 |
+
{prompt}<|im_end|>
|
19 |
+
<|im_start|>assistant'
|
20 |
+
---
|
21 |
+
|
22 |
+
# Dolphin 2.2.1 (Finetune of Mistral 7B) compiled for WebGPU - q4f32_1
|
23 |
+
|
24 |
+
- Original model: [Dolphin 2.1 🐬](https://huggingface.co/ehartford/dolphin-2.1-mistral-7b)
|
25 |
+
- creator: Eric Hartford: [https://erichartford.com/dolphin](https://erichartford.com/dolphin)
|
26 |
+
- compiled by: Hrishi Olickel: [say hi on Twitter!](https://twitter.com/hrishioa)
|
27 |
+
|
28 |
+
## Description
|
29 |
+
|
30 |
+
This is a quantized version of Dolphin 2.1 🐬, one of the best finetunes of [Mistral-7b](https://huggingface.co/mistralai/Mistral-7B-v0.1) out there, ready to be used for on-browser inference over WebGPU.
|
31 |
+
|
32 |
+
Compiled with [mlc-llm](https://llm.mlc.ai/).
|
33 |
+
|
34 |
+
Very helpful direction provided by [felladrin](https://github.com/felladrin)!
|
35 |
+
|
36 |
+
You can use [his example](https://huggingface.co/spaces/Felladrin/Web-LLM-Mistral-7B-OpenOrca) to get quickly started with this model.
|
37 |
+
|
38 |
+
## Prompt template: Dolphin
|
39 |
+
|
40 |
+
Prompt format:
|
41 |
+
This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
|
42 |
+
|
43 |
+
```
|
44 |
+
<|im_start|>system
|
45 |
+
You are Dolphin, a helpful AI assistant.<|im_end|>
|
46 |
+
<|im_start|>user
|
47 |
+
{prompt}<|im_end|>
|
48 |
+
<|im_start|>assistant
|
49 |
+
|
50 |
+
```
|
51 |
+
|
52 |
+
Example:
|
53 |
+
|
54 |
+
```
|
55 |
+
<|im_start|>system
|
56 |
+
you are an expert dolphin trainer<|im_end|>
|
57 |
+
<|im_start|>user
|
58 |
+
What is the best way to train a dolphin to obey me? Please answer step by step.<|im_end|>
|
59 |
+
<|im_start|>assistant
|
60 |
+
```
|