munish0838 commited on
Commit
33eee25
1 Parent(s): a807efe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -2
README.md CHANGED
@@ -3,7 +3,9 @@
3
  license: apache-2.0
4
  pipeline_tag: text-generation
5
  inference: false
6
- base_model: 0-hero/Matter-0.1-7B-DPO-preview
 
 
7
  language:
8
  - en
9
  library_name: transformers
@@ -11,4 +13,75 @@ tags:
11
  - mistral
12
  - conversational
13
  - text-generation-inference
14
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  license: apache-2.0
4
  pipeline_tag: text-generation
5
  inference: false
6
+ # base_model: 0-hero/Matter-0.1-7B-DPO-preview
7
+ datasets:
8
+ - 0-hero/Matter-0.1
9
  language:
10
  - en
11
  library_name: transformers
 
13
  - mistral
14
  - conversational
15
  - text-generation-inference
16
+ ---
17
+
18
+ ## Matter 7B - 0.1 - DPO (Mistral 7B Finetune)
19
+
20
+ ## This is the GGUF version of the model, made for the llama.cpp inference engine.
21
+
22
+ DPO version of [Matter 7B](https://huggingface.co/0-hero/Matter-0.1-7B) fine-tuned on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1), which is curated from over 35 datsets analyzing >6B tokens
23
+
24
+
25
+ ### Training
26
+
27
+ Prompt format: This model uses ChatML prompt format.
28
+ ```
29
+ <|im_start|>system
30
+ You are a helpful AI assistant.<|im_end|>
31
+ <|im_start|>user
32
+ {prompt}<|im_end|>
33
+ <|im_start|>assistant
34
+ ```
35
+ ### Function Calling
36
+
37
+ Model also supports function calling. Additional tokens for function calling
38
+
39
+ Model function call tokens
40
+ - <|begin_func|> - Function call start token
41
+ - <|end_func|> - Function call end token
42
+
43
+ Function call response tokens
44
+ - <|begin_func_response|> - Function response start token
45
+ - <|end_func_response|> - Function response end token
46
+
47
+ Example
48
+ ```
49
+ <|im_start|>system
50
+ You are a helpful assistant with access to the following functions. Use them if required -
51
+ { "name": "get_news_headlines",
52
+ "description": "Get the latest news headlines",
53
+ "parameters":
54
+ { "type": "object",
55
+ "properties":
56
+ { "country":
57
+ { "type": "string",
58
+ "description": "The country for which to fetch news"
59
+ }
60
+ },
61
+ "required": [ "country" ]
62
+ }
63
+ }
64
+ <|im_end|>
65
+ <|im_start|>user
66
+ Can you tell me the latest news headlines for the United States?<|im_end|>
67
+ <|im_start|>assistant
68
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
69
+ <|im_start|>user
70
+ <|begin_func_response|>{
71
+ "headlines":
72
+ [
73
+ "Biden announces new vaccine mandates",
74
+ "Hurricane Ida devastates Louisiana",
75
+ "Apple unveils new iPhone",
76
+ "NASA's Perseverance rover collects first Mars rock sample"
77
+ ]
78
+ }<|end_func_response|>
79
+ <|im_end|>
80
+ <|im_start|>assistant
81
+ Here are the latest news headlines for the United States:
82
+ 1. Biden announces new vaccine mandates
83
+ 2. Hurricane Ida devastates Louisiana
84
+ 3. Apple unveils new iPhone
85
+ 4. NASA's Perseverance rover collects first Mars rock sample
86
+ <|im_end|>
87
+ ```