Lewdiculous commited on
Commit
d43f2ad
1 Parent(s): 4044e95

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Nitral-AI/Mika-Longtext-7b
4
+ - ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ - roleplay
10
+ - mistral
11
+ license: other
12
+ ---
13
+
14
+ This repository hosts GGUF-IQ-Imatrix quants for [Nitral-AI/Mika-Lelantacles-7b-Longtext](https://huggingface.co/Nitral-AI/Mika-Lelantacles-7b-Longtext/).
15
+
16
+ ---
17
+
18
+ This model was merged using the SLERP merge method.
19
+
20
+ ### Models Merged
21
+
22
+ The following models were included in the merge:
23
+ * [Nitral-AI/Mika-Longtext-7b](https://huggingface.co/Nitral-AI/Mika-Longtext-7b)
24
+ * [ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b](https://huggingface.co/ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b)
25
+
26
+ ### Configuration
27
+
28
+ The following YAML configuration was used to produce this model:
29
+
30
+ ```yaml
31
+ slices:
32
+ - sources:
33
+ - model: Nitral-AI/Mika-Longtext-7b
34
+ layer_range: [0, 32]
35
+ - model: ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b
36
+ layer_range: [0, 32]
37
+ merge_method: slerp
38
+ base_model: Nitral-AI/Mika-Longtext-7b
39
+ parameters:
40
+ t:
41
+ - filter: self_attn
42
+ value: [0, 0.5, 0.3, 0.7, 1]
43
+ - filter: mlp
44
+ value: [1, 0.5, 0.7, 0.3, 0]
45
+ - value: 0.5
46
+ dtype: bfloat16
47
+ ```