0-hero commited on
Commit
13ea60b
1 Parent(s): db048d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +73 -0
README.md CHANGED
@@ -1,3 +1,76 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - 0-hero/Matter-0.2-alpha
5
+ language:
6
+ - en
7
  ---
8
+
9
+ ## Matter 7B - 0.2 - DPO (Mistral 7B Finetune)
10
+
11
+ DPO version of [Matter 7B](https://huggingface.co/0-hero/Matter-0.2-7B) fine-tuned on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.2-alpha), which is curated from over 35 datsets analyzing >6B tokens
12
+
13
+
14
+ ### Training
15
+
16
+ Prompt format: This model uses ChatML prompt format.
17
+ ```
18
+ <|im_start|>system
19
+ You are a helpful AI assistant.<|im_end|>
20
+ <|im_start|>user
21
+ {prompt}<|im_end|>
22
+ <|im_start|>assistant
23
+ ```
24
+ ### Function Calling
25
+
26
+ Model also supports function calling. Additional tokens for function calling
27
+
28
+ Model function call tokens
29
+ - <|begin_func|> - Function call start token
30
+ - <|end_func|> - Function call end token
31
+
32
+ Function call response tokens
33
+ - <|begin_func_response|> - Function response start token
34
+ - <|end_func_response|> - Function response end token
35
+
36
+ Example
37
+ ```
38
+ <|im_start|>system
39
+ You are a helpful assistant with access to the following functions. Use them if required -
40
+ { "name": "get_news_headlines",
41
+ "description": "Get the latest news headlines",
42
+ "parameters":
43
+ { "type": "object",
44
+ "properties":
45
+ { "country":
46
+ { "type": "string",
47
+ "description": "The country for which to fetch news"
48
+ }
49
+ },
50
+ "required": [ "country" ]
51
+ }
52
+ }
53
+ <|im_end|>
54
+ <|im_start|>user
55
+ Can you tell me the latest news headlines for the United States?<|im_end|>
56
+ <|im_start|>assistant
57
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
58
+ <|im_start|>user
59
+ <|begin_func_response|>{
60
+ "headlines":
61
+ [
62
+ "Biden announces new vaccine mandates",
63
+ "Hurricane Ida devastates Louisiana",
64
+ "Apple unveils new iPhone",
65
+ "NASA's Perseverance rover collects first Mars rock sample"
66
+ ]
67
+ }<|end_func_response|>
68
+ <|im_end|>
69
+ <|im_start|>assistant
70
+ Here are the latest news headlines for the United States:
71
+ 1. Biden announces new vaccine mandates
72
+ 2. Hurricane Ida devastates Louisiana
73
+ 3. Apple unveils new iPhone
74
+ 4. NASA's Perseverance rover collects first Mars rock sample
75
+ <|im_end|>
76
+ ```