saishf commited on
Commit
212e3e4
1 Parent(s): 5d85000

Upload 6 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Kuno-Lake-7B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Kuno-Lake-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Kuno-Lake-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Kuno-Lake-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Kuno-Lake-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Kuno-Lake-7B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d7120dcfd8b6767a5aaa1501581005fc22a9782697b1fbd53029a250034bfde
3
+ size 2719241920
Kuno-Lake-7B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9203936b5881835e1249c32b6fe61bd7b6ba2243ebfe35858de88bd7e2adc38
3
+ size 3518985920
Kuno-Lake-7B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6729598384f0e02a001126c390d865996d415bab899ee49dd954ec3240933da6
3
+ size 4368438976
Kuno-Lake-7B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:706eea41ea49d5e1939a942bb6ee754d8ab6e3bb7ad11b7272163a251a19880b
3
+ size 5131409088
Kuno-Lake-7B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f138203b4b4cbfb783609e31c0b7c2c928fbf951cc26db3a6f5ba7108e23da39
3
+ size 5942064832
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - mistralai/Mistral-7B-v0.1
4
+ - senseable/WestLake-7B-v2
5
+ - SanjiWatsuki/Kunoichi-DPO-v2-7B
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+
10
+ ---
11
+ # merge
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ ## Merge Details
16
+ ### Merge Method
17
+
18
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2)
24
+ * [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ models:
32
+ - model: mistralai/Mistral-7B-v0.1
33
+ # No parameters necessary for base model
34
+ - model: senseable/WestLake-7B-v2
35
+ parameters:
36
+ density: 0.53
37
+ weight: 0.65
38
+ - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
39
+ parameters:
40
+ density: 0.53
41
+ weight: 0.35
42
+ merge_method: dare_ties
43
+ base_model: mistralai/Mistral-7B-v0.1
44
+ parameters:
45
+ int8_mask: true
46
+ dtype: bfloat16
47
+
48
+ ```