Lewdiculous commited on
Commit
5c52fdf
·
verified ·
1 Parent(s): 7d117e2

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - Nitral-AI/Prima-LelantaclesV6.69-7b
4
+ - Nitral-AI/Prima-LelantaclesV6.31-7b
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ - roleplay
10
+ - mistral
11
+ license: other
12
+ ---
13
+
14
+ This repository hosts GGUF-IQ-Imatrix quants for [ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b](https://huggingface.co/ChaoticNeutrals/Prima-LelantaclesV7-experimental-7b).
15
+
16
+ ```python
17
+ quantization_options = [
18
+ "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
19
+ "Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
20
+ ]
21
+ ```
22
+
23
+ ---
24
+
25
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/im1tX0e_w19J0J0ZrBZhx.jpeg)
26
+
27
+ This model was merged using the SLERP merge method.
28
+
29
+ ### Models Merged
30
+
31
+ The following models were included in the merge:
32
+ * [Nitral-AI/Prima-LelantaclesV6.69-7b](https://huggingface.co/Nitral-AI/Prima-LelantaclesV6.69-7b)
33
+ * [Nitral-AI/Prima-LelantaclesV6.31-7b](https://huggingface.co/Nitral-AI/Prima-LelantaclesV6.31-7b)
34
+
35
+ ### Configuration
36
+
37
+ The following YAML configuration was used to produce this model:
38
+
39
+ ```yaml
40
+ slices:
41
+ - sources:
42
+ - model: Nitral-AI/Prima-LelantaclesV6.69-7b
43
+ layer_range: [0, 32]
44
+ - model: Nitral-AI/Prima-LelantaclesV6.31-7b
45
+ layer_range: [0, 32]
46
+ merge_method: slerp
47
+ base_model: Nitral-AI/Prima-LelantaclesV6.69-7b
48
+ parameters:
49
+ t:
50
+ - filter: self_attn
51
+ value: [0, 0.5, 0.3, 0.7, 1]
52
+ - filter: mlp
53
+ value: [1, 0.5, 0.7, 0.3, 0]
54
+ - value: 0.5
55
+ dtype: bfloat16
56
+ ```