brooketh commited on
Commit
b0166ac
·
verified ·
1 Parent(s): ebd4c97

Upload Fimbulvetr-Holodeck-Erebus-Westlake-10.7B

Browse files
Files changed (1) hide show
  1. README.md +44 -0
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Undi95/Mistral-11B-v0.1
4
+ - Sao10K/Fimbulvetr-11B-v2
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # Fimbulvetr-Holodeck-Erebus-Westlake-10.7B
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [Undi95/Mistral-11B-v0.1](https://huggingface.co/Undi95/Mistral-11B-v0.1) as a base.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
24
+ * MV01-Stacked-Holodeck-Erebus-Westlake-Unhealed-10.7B
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ # Mistral Stack Healing
32
+ merge_method: task_arithmetic
33
+ dtype: float16
34
+ base_model: Undi95/Mistral-11B-v0.1
35
+ models:
36
+ - model: Sao10K/Fimbulvetr-11B-v2
37
+ parameters:
38
+ weight: 1.0
39
+ - model: MV01-Stacked-Holodeck-Erebus-Westlake-Unhealed-10.7B
40
+ parameters:
41
+ weight: 1.0
42
+ name: Fimbulvetr-Holodeck-Erebus-Westlake-10.7B
43
+
44
+ ```