jeiku commited on
Commit
faa9a8f
1 Parent(s): 68309cc

Upload 7 files

Browse files
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ggml-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ggml-model-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ ggml-model-Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ ggml-model-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ ggml-model-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ ggml-model-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - jeiku/Rosa_v1_3B
4
+ - jeiku/Erotica_StableLM
5
+ - jeiku/Rosa_v1_3B
6
+ - jeiku/Toxic_DPO_StableLM
7
+ - jeiku/Rosa_v1_3B
8
+ - jeiku/alpaca-cleaned_StableLM
9
+ - jeiku/Rosa_v1_3B
10
+ - jeiku/Gnosis_StableLM
11
+ - jeiku/Rosa_v1_3B
12
+ - jeiku/No_Robots_Alpaca_StableLM
13
+ - jeiku/Rosa_v1_3B
14
+ - jeiku/smol_PIPPA_StableLM
15
+ - jeiku/Rosa_v1_3B
16
+ tags:
17
+ - mergekit
18
+ - merge
19
+
20
+ ---
21
+ # output
22
+
23
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
24
+
25
+ ## Merge Details
26
+ ### Merge Method
27
+
28
+ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) as a base.
29
+
30
+ ### Models Merged
31
+
32
+ The following models were included in the merge:
33
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/Erotica_StableLM](https://huggingface.co/jeiku/Erotica_StableLM)
34
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/Toxic_DPO_StableLM](https://huggingface.co/jeiku/Toxic_DPO_StableLM)
35
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/alpaca-cleaned_StableLM](https://huggingface.co/jeiku/alpaca-cleaned_StableLM)
36
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/Gnosis_StableLM](https://huggingface.co/jeiku/Gnosis_StableLM)
37
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/No_Robots_Alpaca_StableLM](https://huggingface.co/jeiku/No_Robots_Alpaca_StableLM)
38
+ * [jeiku/Rosa_v1_3B](https://huggingface.co/jeiku/Rosa_v1_3B) + [jeiku/smol_PIPPA_StableLM](https://huggingface.co/jeiku/smol_PIPPA_StableLM)
39
+
40
+ ### Configuration
41
+
42
+ The following YAML configuration was used to produce this model:
43
+
44
+ ```yaml
45
+ models:
46
+ - model: jeiku/Rosa_v1_3B+jeiku/No_Robots_Alpaca_StableLM
47
+ parameters:
48
+ weight: 0.15
49
+ density: 0.166
50
+ - model: jeiku/Rosa_v1_3B+jeiku/Gnosis_StableLM
51
+ parameters:
52
+ weight: 0.2
53
+ density: 0.166
54
+ - model: jeiku/Rosa_v1_3B+jeiku/Erotica_StableLM
55
+ parameters:
56
+ weight: 0.15
57
+ density: 0.166
58
+ - model: jeiku/Rosa_v1_3B+jeiku/smol_PIPPA_StableLM
59
+ parameters:
60
+ weight: 0.2
61
+ density: 0.166
62
+ - model: jeiku/Rosa_v1_3B+jeiku/alpaca-cleaned_StableLM
63
+ parameters:
64
+ weight: 0.1
65
+ density: 0.166
66
+ - model: jeiku/Rosa_v1_3B+jeiku/Toxic_DPO_StableLM
67
+ parameters:
68
+ weight: 0.2
69
+ density: 0.166
70
+ merge_method: dare_ties
71
+ base_model: jeiku/Rosa_v1_3B
72
+ parameters:
73
+ dtype: bfloat16
74
+ ```
ggml-model-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0111726d8dab9fac9a7c16b06e119ebc913e1382825a1a854fe30d3e9ba90484
3
+ size 1198771520
ggml-model-Q3_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3bcfd7ed5ce00177e27d82229ececa537c95e147a9026faa7b2738929788126e
3
+ size 1391419200
ggml-model-Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c01e6008f21ce2f5cf1303ada5782087981922d65fb01c6e0bff853c4199079
3
+ size 1708595520
ggml-model-Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16aeb6c5e609c6a27aec7df4a3144b15ac3129bc54a4ba4bc57bfe656d56fe73
3
+ size 1993390400
ggml-model-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f6eb0405bd54e00cd34044f1bff645036e0f8ae0be74c93031fe619c1c7c710
3
+ size 2295984960
ggml-model-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52f0e7c0de826e4811159979d0f2d30fedee9227290fe04f314d6451bd37d2e0
3
+ size 5593341696