Edit model card

WestLakeX-7B-EvoMerge

This is the result of a small-scale EvoMerge.
(Experiment Conclusion: Higher mutation strength does not seem to improve performance so far. Average eval score is below all candidates in initial population. Though this is a single experiment, it is not definitive that higher mutation strength is unnecessary. For example, it could be useful at a bigger scale.)

Zoom in to view the family tree: image/png

Downloads last month
2,573
Safetensors
Model size
7.24B params
Tensor type
FP16
·
Invalid base_model specified in model card metadata. Needs to be a model id from hf.co/models.

Dataset used to train BarryFutureman/WestLakeX-7B-EvoMerge