RichardErkhov commited on
Commit
e17d167
1 Parent(s): 2c3e7da

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ zephyr-neural-chat-frankenmerge11b - bnb 4bits
11
+ - Model creator: https://huggingface.co/S4sch/
12
+ - Original model: https://huggingface.co/S4sch/zephyr-neural-chat-frankenmerge11b/
13
+
14
+
15
+
16
+
17
+ Original model description:
18
+ ---
19
+ license: apache-2.0
20
+ ---
21
+
22
+ Frankenmerge 11b between HuggingFaceH4/zephyr-7b-beta and Intel/neural-chat-7b-v3-1
23
+
24
+ Merge with the following conditions (via mergekit on github)
25
+
26
+
27
+ model: Intel/neural-chat-7b-v3-1
28
+ layer_range: [0, 8]
29
+
30
+ model: HuggingFaceH4/zephyr-7b-beta
31
+ layer_range: [4, 12]
32
+
33
+ model: Intel/neural-chat-7b-v3-1
34
+ layer_range: [9, 16]
35
+
36
+ model: HuggingFaceH4/zephyr-7b-beta
37
+ layer_range: [13, 20]
38
+
39
+ model: Intel/neural-chat-7b-v3-1
40
+ layer_range: [17, 24]
41
+
42
+ model: HuggingFaceH4/zephyr-7b-beta
43
+ layer_range: [21, 28]
44
+
45
+ model: Intel/neural-chat-7b-v3-1
46
+ layer_range: [25, 32]
47
+
48
+ merge_method: passthrough
49
+
50
+
51
+