Virt-io commited on
Commit
da19f8a
1 Parent(s): 565335c

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ irene-rp-v5-7b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ irene-rp-v5-7b.fp16.gguf.Imatrix-ChatML.dat filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ tags:
4
+ - mergekit
5
+ - merge
6
+ - mistral
7
+ - roleplay
8
+ ---
9
+
10
+ # Info
11
+
12
+ Remake of v4 with the new merge method.
13
+
14
+ Very intersting model, works well with smooth sampling 0.25 and minP 0.075
15
+
16
+ ChatML and Alpaca
17
+
18
+ # Irene-RP-v5-7B
19
+
20
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
21
+
22
+ ## Merge Details
23
+ ### Merge Method
24
+
25
+ This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using /mnt/2TB/Models/Sharded/Mistral-7B-v0.2-hf-sharded as a base.
26
+
27
+ ### Models Merged
28
+
29
+ The following models were included in the merge:
30
+ * [l3utterfly/mistral-7b-v0.2-layla-v4](https://huggingface.co/l3utterfly/mistral-7b-v0.2-layla-v4)
31
+ * [Locutusque/Hercules-4.0-Mistral-v0.2-7B](https://huggingface.co/Locutusque/Hercules-4.0-Mistral-v0.2-7B)
32
+ * [Weyaxi/Einstein-v5-v0.2-7B](https://huggingface.co/Weyaxi/Einstein-v5-v0.2-7B)
33
+ * [Virt-io/Irene-RP-v3-7B](https://huggingface.co/Virt-io/Irene-RP-v3-7B)
34
+
35
+ ### Configuration
36
+
37
+ The following YAML configuration was used to produce this model:
38
+
39
+ ```yaml
40
+ models:
41
+ - model: alpindale/Mistral-7B-v0.2-hf
42
+ - model: l3utterfly/mistral-7b-v0.2-layla-v4
43
+ - model: mergekit/Hercules_Einstein_MODELSTOCK
44
+ - model: Virt-io/Irene-RP-v3-7B
45
+ merge_method: model_stock
46
+ base_model: alpindale/Mistral-7B-v0.2-hf
47
+ dtype: float16
48
+ ```
irene-rp-v5-7b.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:961d58c9202c0f49af1aa332e87c35c984f076082bac8160d4c01916ea4a86ec
3
+ size 14484731584
irene-rp-v5-7b.fp16.gguf.Imatrix-ChatML.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b7d9ba716f680a156f6efbb6a52d0c49debbab2bb692c7729989ca2f4f69891
3
+ size 4988126