0-hero commited on
Commit
035c819
1 Parent(s): 227fa9c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md CHANGED
@@ -1,3 +1,75 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - 0-hero/Matter-0.1
5
+ language:
6
+ - en
7
  ---
8
+
9
+ ## Matter 7B - 0.1 (Mistral 7B Finetune)
10
+
11
+ Matter 7B is full-finetune on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1), which is curated from over 35 datsets analyzing >6B tokens
12
+
13
+ ### Training
14
+
15
+ Prompt format: This model uses ChatML prompt format.
16
+ ```
17
+ <|im_start|>system
18
+ You are a helpful AI assistant.<|im_end|>
19
+ <|im_start|>user
20
+ {prompt}<|im_end|>
21
+ <|im_start|>assistant
22
+ ```
23
+ ### Function Calling
24
+
25
+ Model also supports function calling. Additional tokens for function calling
26
+
27
+ Model function call tokens
28
+ - <|begin_func|> - Function call start token
29
+ - <|end_func|> - Function call end token
30
+
31
+ Function call response tokens
32
+ - <|begin_func_response|> - Function response start token
33
+ - <|end_func_response|> - Function response end token
34
+
35
+ Example
36
+ ```
37
+ <|im_start|>system
38
+ You are a helpful assistant with access to the following functions. Use them if required -
39
+ { "name": "get_news_headlines",
40
+ "description": "Get the latest news headlines",
41
+ "parameters":
42
+ { "type": "object",
43
+ "properties":
44
+ { "country":
45
+ { "type": "string",
46
+ "description": "The country for which to fetch news"
47
+ }
48
+ },
49
+ "required": [ "country" ]
50
+ }
51
+ }
52
+ <|im_end|>
53
+ <|im_start|>user
54
+ Can you tell me the latest news headlines for the United States?<|im_end|>
55
+ <|im_start|>assistant
56
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
57
+ <|im_start|>user
58
+ <|begin_func_response|>{
59
+ "headlines":
60
+ [
61
+ "Biden announces new vaccine mandates",
62
+ "Hurricane Ida devastates Louisiana",
63
+ "Apple unveils new iPhone",
64
+ "NASA's Perseverance rover collects first Mars rock sample"
65
+ ]
66
+ }<|end_func_response|>
67
+ <|im_end|>
68
+ <|im_start|>assistant
69
+ Here are the latest news headlines for the United States:
70
+ 1. Biden announces new vaccine mandates
71
+ 2. Hurricane Ida devastates Louisiana
72
+ 3. Apple unveils new iPhone
73
+ 4. NASA's Perseverance rover collects first Mars rock sample
74
+ <|im_end|>
75
+ ```