Blackroot

/

FrankensteinsMonster-13B

like 2

Hey would it be possible to get the merge script or pointed in the right direction for it?
Thanks, Emma

I've built a webui that did the training and merging, https://github.com/CoffeeVampir3/ez-trainer

If you're more interested in the technical details, the code is here https://github.com/CoffeeVampir3/ez-trainer/blob/main/mechanisms/merge_lora.py
And my rambling unsorted thoughts and testing to build the merge code is here https://gist.github.com/CoffeeVampir3/6156f4ba083848f59ff41b96f7ff0988

Your the best!