LeroyDyer commited on
Commit
fcafca9
1 Parent(s): 4d77c0d

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - mistralai/Mistral-7B-Instruct-v0.2
4
+ - NousResearch/Hermes-2-Pro-Mistral-7B
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # MODEL_NAME
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2)
24
+ * [NousResearch/Hermes-2-Pro-Mistral-7B](https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B)
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+
32
+ models:
33
+ - model: mistralai/Mistral-7B-Instruct-v0.2
34
+ parameters:
35
+ weight: 1.0
36
+ - model: NousResearch/Hermes-2-Pro-Mistral-7B
37
+ parameters:
38
+ weight: 0.3
39
+ merge_method: linear
40
+ dtype: float16
41
+
42
+ ```