LeroyDyer commited on
Commit
350201d
1 Parent(s): 0941259

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Nitral-AI/ProdigyXBioMistral_7B
4
+ - LeroyDyer/Mixtral_AI
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # MODEL_NAME
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * [Nitral-AI/ProdigyXBioMistral_7B](https://huggingface.co/Nitral-AI/ProdigyXBioMistral_7B)
24
+ * [LeroyDyer/Mixtral_AI](https://huggingface.co/LeroyDyer/Mixtral_AI)
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+
32
+ models:
33
+ - model: LeroyDyer/Mixtral_AI
34
+ parameters:
35
+ weight: 0.789
36
+ - model: Nitral-AI/ProdigyXBioMistral_7B
37
+ parameters:
38
+ weight: 0.2312
39
+ merge_method: linear
40
+ dtype: float16
41
+
42
+ ```