Help request with LazyMergeKit for Falcon 7B
#18 opened 6 months ago
by
Ali-C137
![](https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png)
Custom merge kit
1
#17 opened 7 months ago
by
Vezora
![](https://cdn-avatars.huggingface.co/v1/production/uploads/649a54b896d5747b35e2163b/tdZmsov6fN1VHztaE5kX9.jpeg)
Code used for merging
#16 opened 7 months ago
by
NTaylor
hello mlabonne, can you share the mergekit's merge.yaml of phixtral-4x2_8
2
#15 opened 7 months ago
by
TomPei
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64c71b27d43e4dee51a8b31a/OCIR_yABnUZZMPKFBgzJt.png)
Update the model type to make it compatible with mlx-lm's model mapping.
4
#14 opened 7 months ago
by
mzbac
which merge method(s) did you try?
1
#13 opened 7 months ago
by
alanchan808
phixtral-3x2_8
1
#12 opened 7 months ago
by
vince62s
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6495b47a74ce69cc4eab61f0/2eg17fMXjshpfQfSq5jyP.png)
About positive_prompts
1
#10 opened 7 months ago
by
Xiaoye08
Script for eval
1
#9 opened 7 months ago
by
ewqr2130
gguf
1
#7 opened 8 months ago
by
LaferriereJC
How did you train the gating?
10
#6 opened 8 months ago
by
osanseviero
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6032802e1f993496bc14d9e3/w6hr-DEQot4VVkoyRIBiy.png)
VRAM need for inference
2
#5 opened 8 months ago
by
RizSoto
convert phi to phixtral
3
#4 opened 8 months ago
by
NickyNicky
![](https://cdn-avatars.huggingface.co/v1/production/uploads/641b435ba5f876fe30c5ae0a/OknUuweWxX3IzUZIKZ6CF.png)
Inference
2
#2 opened 8 months ago
by
marcel