nwhamed commited on
Commit
5399583
1 Parent(s): 342bbcd

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - roberta-base
8
+ ---
9
+
10
+ # bert-roberta-merged
11
+
12
+ bert-roberta-merged is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
13
+ * [roberta-base](https://huggingface.co/roberta-base)
14
+
15
+ ## 🧩 Configuration
16
+
17
+ ```yaml
18
+ models:
19
+ - model: bert-base-uncased
20
+ - model: roberta-base
21
+ parameters:
22
+ density: 0.5
23
+ weight: 0.5
24
+ merge_method: ties
25
+ base_model: bert-base-uncased
26
+ parameters:
27
+ normalize: true
28
+ dtype: float16
29
+ ```