0-hero commited on
Commit
ec4c58e
1 Parent(s): 8e9bc19

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -0
README.md CHANGED
@@ -1,3 +1,78 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - 0-hero/Matter-0.2-alpha-Slim-A
5
+ language:
6
+ - en
7
  ---
8
+
9
+ ## Matter 8x22B - 0.2 (Mixtral 8x22B 0.2 Finetune)
10
+
11
+ Matter 8x22B 0.2 is finetune on the **Matter 0.2 dataset**, which is curated from over 35 datsets analyzing >6B tokens
12
+
13
+ ### Recommended Usage for best results
14
+ System Prompt - `You are a helpful assistant`
15
+
16
+ ### Training
17
+
18
+ Prompt format: This model uses ChatML prompt format.
19
+ ```
20
+ <|im_start|>system
21
+ You are a helpful AI assistant.<|im_end|>
22
+ <|im_start|>user
23
+ {prompt}<|im_end|>
24
+ <|im_start|>assistant
25
+ ```
26
+ ### Function Calling
27
+
28
+ Model also supports function calling. Additional tokens for function calling
29
+
30
+ Model function call tokens
31
+ - `<tool_call>` - Function call start token
32
+ - `</tool_call>` - Function call end token
33
+
34
+ Function call response tokens
35
+ - `<tool_response>` - Function response start token
36
+ - `</tool_response>` - Function response end token
37
+
38
+ Example
39
+ ```
40
+ <|im_start|>system
41
+ You are a helpful assistant with access to the following functions. Use them if required -
42
+ { "name": "get_news_headlines",
43
+ "description": "Get the latest news headlines",
44
+ "parameters":
45
+ { "type": "object",
46
+ "properties":
47
+ { "country":
48
+ { "type": "string",
49
+ "description": "The country for which to fetch news"
50
+ }
51
+ },
52
+ "required": [ "country" ]
53
+ }
54
+ }
55
+ <|im_end|>
56
+ <|im_start|>user
57
+ Can you tell me the latest news headlines for the United States?<|im_end|>
58
+ <|im_start|>assistant
59
+ <tool_call>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}</tool_call><|im_end|>
60
+ <|im_start|>user
61
+ <tool_response>{
62
+ "headlines":
63
+ [
64
+ "Biden announces new vaccine mandates",
65
+ "Hurricane Ida devastates Louisiana",
66
+ "Apple unveils new iPhone",
67
+ "NASA's Perseverance rover collects first Mars rock sample"
68
+ ]
69
+ }</tool_response>
70
+ <|im_end|>
71
+ <|im_start|>assistant
72
+ Here are the latest news headlines for the United States:
73
+ 1. Biden announces new vaccine mandates
74
+ 2. Hurricane Ida devastates Louisiana
75
+ 3. Apple unveils new iPhone
76
+ 4. NASA's Perseverance rover collects first Mars rock sample
77
+ <|im_end|>
78
+ ```