Hugging Face's logo

Replete-AI
/
Phi-Elothir

Text Generation
Transformers
Safetensors
English
phi
conversational
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
1
Kquant03 Joseph717171 commited on
Commit
ab70efb
•
1 Parent(s): 074939c

Update README.md (#1)

Browse files

- Update README.md (442787a48c62b18347c21ea9556f646aeccebe66)


Co-authored-by: Joseph <Joseph717171@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +102 -1
README.md CHANGED
@@ -66,4 +66,105 @@ if __name__ == "__main__":
66
 
67
  The model uses the same chat template as found in Mistral instruct models:
68
 
69
- # [Join the Replete AI Discord here!](https://discord.gg/tG5aY4EX4T)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
 
67
  The model uses the same chat template as found in Mistral instruct models:
68
 
69
+ # [Join the Replete AI Discord here!](https://discord.gg/tG5aY4EX4T)
70
+
71
+ # Merge Recipe:
72
+
73
+ ```yml
74
+ dtype: float16
75
+ merge_method: passthrough
76
+ slices:
77
+ - sources:
78
+ - model: abacaj/phi-2-super
79
+ layer_range: [0,2]
80
+ - sources:
81
+ - model: abacaj/phi-2-super
82
+ layer_range: [1,3]
83
+ - sources:
84
+ - model: abacaj/phi-2-super
85
+ layer_range: [2,4]
86
+ - sources:
87
+ - model: abacaj/phi-2-super
88
+ layer_range: [3,5]
89
+ - sources:
90
+ - model: abacaj/phi-2-super
91
+ layer_range: [4,6]
92
+ - sources:
93
+ - model: abacaj/phi-2-super
94
+ layer_range: [5,7]
95
+ - sources:
96
+ - model: abacaj/phi-2-super
97
+ layer_range: [6,8]
98
+ - sources:
99
+ - model: abacaj/phi-2-super
100
+ layer_range: [7,9]
101
+ - sources:
102
+ - model: abacaj/phi-2-super
103
+ layer_range: [8,10]
104
+ - sources:
105
+ - model: abacaj/phi-2-super
106
+ layer_range: [9,11]
107
+ - sources:
108
+ - model: abacaj/phi-2-super
109
+ layer_range: [10,12]
110
+ - sources:
111
+ - model: abacaj/phi-2-super
112
+ layer_range: [11,13]
113
+ - sources:
114
+ - model: abacaj/phi-2-super
115
+ layer_range: [12,14]
116
+ - sources:
117
+ - model: abacaj/phi-2-super
118
+ layer_range: [13,15]
119
+ - sources:
120
+ - model: abacaj/phi-2-super
121
+ layer_range: [14,16]
122
+ - sources:
123
+ - model: abacaj/phi-2-super
124
+ layer_range: [15,17]
125
+ - sources:
126
+ - model: abacaj/phi-2-super
127
+ layer_range: [16,18]
128
+ - sources:
129
+ - model: abacaj/phi-2-super
130
+ layer_range: [17,19]
131
+ - sources:
132
+ - model: abacaj/phi-2-super
133
+ layer_range: [18,20]
134
+ - sources:
135
+ - model: abacaj/phi-2-super
136
+ layer_range: [19,21]
137
+ - sources:
138
+ - model: abacaj/phi-2-super
139
+ layer_range: [20,22]
140
+ - sources:
141
+ - model: abacaj/phi-2-super
142
+ layer_range: [21,23]
143
+ - sources:
144
+ - model: abacaj/phi-2-super
145
+ layer_range: [22,24]
146
+ - sources:
147
+ - model: abacaj/phi-2-super
148
+ layer_range: [23,25]
149
+ - sources:
150
+ - model: abacaj/phi-2-super
151
+ layer_range: [24,26]
152
+ - sources:
153
+ - model: abacaj/phi-2-super
154
+ layer_range: [25,27]
155
+ - sources:
156
+ - model: abacaj/phi-2-super
157
+ layer_range: [26,28]
158
+ - sources:
159
+ - model: abacaj/phi-2-super
160
+ layer_range: [27,29]
161
+ - sources:
162
+ - model: abacaj/phi-2-super
163
+ layer_range: [28,30]
164
+ - sources:
165
+ - model: abacaj/phi-2-super
166
+ layer_range: [29,31]
167
+ - sources:
168
+ - model: abacaj/phi-2-super
169
+ layer_range: [30,32]
170
+ ```