Lewdiculous commited on
Commit
43e1c74
1 Parent(s): ff5df08

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -1
README.md CHANGED
@@ -4,4 +4,27 @@
4
 
5
  All credits belong to the [creator](https://huggingface.co/Test157t/).
6
 
7
- `Base⇢ GGUF(F16)⇢ GGUF(Quants)`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
  All credits belong to the [creator](https://huggingface.co/Test157t/).
6
 
7
+ `Base⇢ GGUF(F16)⇢ GGUF(Quants)`
8
+
9
+ ---
10
+
11
+ The following YAML configuration was used to produce this model:
12
+
13
+ ```yaml
14
+ slices:
15
+ - sources:
16
+ - model: Test157t/Yarncules-7b-128k
17
+ layer_range: [0, 32]
18
+ - model: Test157t/Prima-LelantaclesV3-7b
19
+ layer_range: [0, 32]
20
+ merge_method: slerp
21
+ base_model: Test157t/Prima-LelantaclesV3-7b
22
+ parameters:
23
+ t:
24
+ - filter: self_attn
25
+ value: [0, 0.5, 0.3, 0.7, 1]
26
+ - filter: mlp
27
+ value: [1, 0.5, 0.7, 0.3, 0]
28
+ - value: 0.5
29
+ dtype: bfloat16
30
+ ```