0-hero commited on
Commit
195d352
1 Parent(s): c0ef05b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -0
README.md CHANGED
@@ -1,3 +1,78 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - 0-hero/Matter-0.1-Slim-B
5
+ language:
6
+ - en
7
  ---
8
+
9
+ ## Matter 7B (Mistral 7B Finetune)
10
+
11
+ Matter 7B is an extended full-finetune on the [slim-B version of the Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1-Slim-B), which is curated from over 35 datsets analyzing >6B tokens
12
+
13
+ ### Training
14
+
15
+ It took ~15 hours to train 3 epochs on 4x A100s (80GB) using Axolotl for a full-finetune
16
+
17
+ Prompt format: This model uses ChatML prompt format.
18
+ ```
19
+ <|im_start|>system
20
+ You are a helpful AI assistant.<|im_end|>
21
+ <|im_start|>user
22
+ {prompt}<|im_end|>
23
+ <|im_start|>assistant
24
+ ```
25
+ ### Function Calling
26
+
27
+ Model also supports function calling. Additional tokens for function calling
28
+
29
+ Model function call tokens
30
+ - <|begin_func|> - Function call start token
31
+ - <|end_func|> - Function call end token
32
+
33
+ Function call response tokens
34
+ - <|begin_func_response|> - Function response start token
35
+ - <|end_func_response|> - Function response end token
36
+
37
+ Example
38
+ ```
39
+ <|im_start|>system
40
+ You are a helpful assistant with access to the following functions. Use them if required -
41
+ { "name": "get_news_headlines",
42
+ "description": "Get the latest news headlines",
43
+ "parameters":
44
+ { "type": "object",
45
+ "properties":
46
+ { "country":
47
+ { "type": "string",
48
+ "description": "The country for which to fetch news"
49
+ }
50
+ },
51
+ "required": [ "country" ]
52
+ }
53
+ }
54
+ <|im_end|>
55
+ <|im_start|>user
56
+ Can you tell me the latest news headlines for the United States?<|im_end|>
57
+ <|im_start|>assistant
58
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
59
+ <|im_start|>user
60
+ <|begin_func_response|>{
61
+ "headlines":
62
+ [
63
+ "Biden announces new vaccine mandates",
64
+ "Hurricane Ida devastates Louisiana",
65
+ "Apple unveils new iPhone",
66
+ "NASA's Perseverance rover collects first Mars rock sample"
67
+ ]
68
+ }<|end_func_response|>
69
+ <|im_end|>
70
+ <|im_start|>assistant
71
+ Here are the latest news headlines for the United States:
72
+ 1. Biden announces new vaccine mandates
73
+ 2. Hurricane Ida devastates Louisiana
74
+ 3. Apple unveils new iPhone
75
+ 4. NASA's Perseverance rover collects first Mars rock sample
76
+ <|im_end|>
77
+ ```
78
+