munish0838 commited on
Commit
2828b63
1 Parent(s): c2bf60b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -2
README.md CHANGED
@@ -2,7 +2,9 @@
2
  license: apache-2.0
3
  language:
4
  - en
5
- base_model: 0-hero/Matter-0.1-7B-boost-DPO-preview
 
 
6
  library_name: transformers
7
  pipeline_tag: text-generation
8
  inference: False
@@ -10,4 +12,75 @@ tags:
10
  - mistral
11
  - conversational
12
  - text-generation-inference
13
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  language:
4
  - en
5
+ # base_model: 0-hero/Matter-0.1-7B-boost-DPO-preview
6
+ datasets:
7
+ - 0-hero/Matter-0.1
8
  library_name: transformers
9
  pipeline_tag: text-generation
10
  inference: False
 
12
  - mistral
13
  - conversational
14
  - text-generation-inference
15
+ ---
16
+
17
+ ## Matter 7B - 0.1 Boost - DPO (Mistral 7B Finetune)
18
+
19
+ ## This is the GGUF version of the model, made for the llama.cpp inference engine.
20
+
21
+ DPO version of [Matter 7B Boost](https://huggingface.co/0-hero/Matter-0.1-7B-boost) fine-tuned on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1), which is curated from over 35 datsets analyzing >6B tokens
22
+
23
+
24
+ ### Training
25
+
26
+ Prompt format: This model uses ChatML prompt format.
27
+ ```
28
+ <|im_start|>system
29
+ You are a helpful AI assistant.<|im_end|>
30
+ <|im_start|>user
31
+ {prompt}<|im_end|>
32
+ <|im_start|>assistant
33
+ ```
34
+ ### Function Calling
35
+
36
+ Model also supports function calling. Additional tokens for function calling
37
+
38
+ Model function call tokens
39
+ - <|begin_func|> - Function call start token
40
+ - <|end_func|> - Function call end token
41
+
42
+ Function call response tokens
43
+ - <|begin_func_response|> - Function response start token
44
+ - <|end_func_response|> - Function response end token
45
+
46
+ Example
47
+ ```
48
+ <|im_start|>system
49
+ You are a helpful assistant with access to the following functions. Use them if required -
50
+ { "name": "get_news_headlines",
51
+ "description": "Get the latest news headlines",
52
+ "parameters":
53
+ { "type": "object",
54
+ "properties":
55
+ { "country":
56
+ { "type": "string",
57
+ "description": "The country for which to fetch news"
58
+ }
59
+ },
60
+ "required": [ "country" ]
61
+ }
62
+ }
63
+ <|im_end|>
64
+ <|im_start|>user
65
+ Can you tell me the latest news headlines for the United States?<|im_end|>
66
+ <|im_start|>assistant
67
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
68
+ <|im_start|>user
69
+ <|begin_func_response|>{
70
+ "headlines":
71
+ [
72
+ "Biden announces new vaccine mandates",
73
+ "Hurricane Ida devastates Louisiana",
74
+ "Apple unveils new iPhone",
75
+ "NASA's Perseverance rover collects first Mars rock sample"
76
+ ]
77
+ }<|end_func_response|>
78
+ <|im_end|>
79
+ <|im_start|>assistant
80
+ Here are the latest news headlines for the United States:
81
+ 1. Biden announces new vaccine mandates
82
+ 2. Hurricane Ida devastates Louisiana
83
+ 3. Apple unveils new iPhone
84
+ 4. NASA's Perseverance rover collects first Mars rock sample
85
+ <|im_end|>
86
+ ```