alvarobartt HF staff commited on
Commit
205c055
·
1 Parent(s): c3e0237

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -158
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  model-index:
3
- - name: notus-7b-dpo-lora
4
  results: []
5
  datasets:
6
  - argilla/ultrafeedback-binarized-avg-rating-for-dpo
@@ -16,20 +16,17 @@ tags:
16
  license: apache-2.0
17
  ---
18
 
19
- # Model Card for Notus 7B
20
 
21
  <div align="center">
22
- <img src="https://cdn-uploads.huggingface.co/production/uploads/60f0608166e5701b80ed3f02/LU-vKiC0R7UxxITrwE1F_.png"/>
23
- <p style="text-align: center;">
24
- Image was artificially generated by Dalle-3 via ChatGPT Pro
25
- </p>
26
  </div>
27
 
28
  Notus is going to be a collection of fine-tuned models using DPO, similarly to Zephyr, but mainly focused
29
  on the Direct Preference Optimization (DPO) step, aiming to incorporate preference feedback into the LLMs
30
  when fine-tuning those. Notus models are intended to be used as assistants via chat-like applications, and
31
- are evaluated with the MT-Bench and AlpacaEval benchmarks, to be directly compared with Zephyr fine-tuned models
32
- also using DPO.
33
 
34
  ## Model Details
35
 
@@ -44,154 +41,6 @@ also using DPO.
44
 
45
  ### Model Sources [optional]
46
 
47
- - **Repository:** https://github.com/argilla-io/notus-7b-dpo
48
  - **Paper:** N/A
49
- - **Demo:** https://argilla-notus-chat-ui.hf.space/
50
-
51
- ## Uses
52
-
53
- <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
54
-
55
- ### Direct Use
56
-
57
- <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
58
-
59
- [More Information Needed]
60
-
61
- ### Downstream Use [optional]
62
-
63
- <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
64
-
65
- [More Information Needed]
66
-
67
- ### Out-of-Scope Use
68
-
69
- <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
70
-
71
- [More Information Needed]
72
-
73
- ## Bias, Risks, and Limitations
74
-
75
- <!-- This section is meant to convey both technical and sociotechnical limitations. -->
76
-
77
- [More Information Needed]
78
-
79
- ### Recommendations
80
-
81
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
82
-
83
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
84
-
85
- ## How to Get Started with the Model
86
-
87
- Use the code below to get started with the model.
88
-
89
- [More Information Needed]
90
-
91
- ## Training Details
92
-
93
- ### Training Data
94
-
95
- <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
96
-
97
- [More Information Needed]
98
-
99
- ### Training Procedure
100
-
101
- <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
102
-
103
- #### Preprocessing [optional]
104
-
105
- [More Information Needed]
106
-
107
-
108
- #### Training Hyperparameters
109
-
110
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
111
-
112
- #### Speeds, Sizes, Times [optional]
113
-
114
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
115
-
116
- [More Information Needed]
117
-
118
- ## Evaluation
119
-
120
- <!-- This section describes the evaluation protocols and provides the results. -->
121
-
122
- ### Testing Data, Factors & Metrics
123
-
124
- #### Testing Data
125
-
126
- <!-- This should link to a Data Card if possible. -->
127
-
128
- [More Information Needed]
129
-
130
- #### Factors
131
-
132
- <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
133
-
134
- [More Information Needed]
135
-
136
- #### Metrics
137
-
138
- <!-- These are the evaluation metrics being used, ideally with a description of why. -->
139
-
140
- [More Information Needed]
141
-
142
- ### Results
143
-
144
- [More Information Needed]
145
-
146
- #### Summary
147
-
148
-
149
- ## Technical Specifications
150
-
151
- ### Model Architecture and Objective
152
-
153
- [More Information Needed]
154
-
155
- ### Compute Infrastructure
156
-
157
- [More Information Needed]
158
-
159
- #### Hardware
160
-
161
- 8 x A100 40GB
162
-
163
- #### Software
164
-
165
- [More Information Needed]
166
-
167
- ## Citation [optional]
168
-
169
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
170
-
171
- **BibTeX:**
172
-
173
- [More Information Needed]
174
-
175
- **APA:**
176
-
177
- [More Information Needed]
178
-
179
- ## Glossary [optional]
180
-
181
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
182
-
183
- [More Information Needed]
184
-
185
- ## More Information [optional]
186
-
187
- [More Information Needed]
188
-
189
- ## Model Card Authors [optional]
190
-
191
- [More Information Needed]
192
-
193
- ## Model Card Contact
194
-
195
- [More Information Needed]
196
-
197
- ## Training procedure
 
1
  ---
2
  model-index:
3
+ - name: notus-7b-v1-lora
4
  results: []
5
  datasets:
6
  - argilla/ultrafeedback-binarized-avg-rating-for-dpo
 
16
  license: apache-2.0
17
  ---
18
 
19
+ # Model Card for Notus 7B v1 (LoRA)
20
 
21
  <div align="center">
22
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/60f0608166e5701b80ed3f02/LU-vKiC0R7UxxITrwE1F_.png" alt="Image was artificially generated by Dalle-3 via ChatGPT Pro"/>
 
 
 
23
  </div>
24
 
25
  Notus is going to be a collection of fine-tuned models using DPO, similarly to Zephyr, but mainly focused
26
  on the Direct Preference Optimization (DPO) step, aiming to incorporate preference feedback into the LLMs
27
  when fine-tuning those. Notus models are intended to be used as assistants via chat-like applications, and
28
+ are evaluated with the MT-Bench, AlpacaEval, and LM Evaluation Harness benchmarks, to be directly compared
29
+ with Zephyr fine-tuned models also using DPO.
30
 
31
  ## Model Details
32
 
 
41
 
42
  ### Model Sources [optional]
43
 
44
+ - **Repository:** https://github.com/argilla-io/notus-7b
45
  - **Paper:** N/A
46
+ - **Demo:** https://argilla-notus-chat-ui.hf.space/