Merge Idea
Hello! I wasn't sure where to post this, but I had an idea of a model merge I'd be interested in seeing the results of, and you seemed like you make a bunch.
You know better what makes a good merge, but I was thinking that merging the models that are best at each category (and still good overall) in the UGI-Leaderboard would be a cool experiment.
I was thinking:
PJMixers/LLaMa-3-CursedStock-v1.8-8B
v000000/L3-8B-Poppy-Sunspice
tannedbum/L3-Nymeria-8B
bluuwhale/L3-SthenoMaidBlackroot-8B-V1
Nitral-AI/Hathor_RP-v.01-L3-8B
Hello, sounds interesting, i didn't know i was on the leaderboard! I started the merge process with dare_ties, it should be up soon, "L3-8B-UGI-DontPlanToEnd-test". Usually merging large merges together doesn't give good results because of the quality loss of merging once, and some for converting fp16 to bf16 etc that has already occurred. And then doing it twice usually ends poorly.