Discuss about DARE

#1
by HoangHa - opened

I tested the model and it works perfectly for role-playing. I'm curious of how can we convert the model to DARE?

Ah, I used MergeKit. The DARE paper talking about converting the model to a DARE format gave me quite a bit of confusion too, but the repo handles all of that and produces a normal model (like this one) again at the end.

Thank you for pointing out.

Wow I saw the branch “dare” in Mergekit repo. Is that what you did?

And one more stupid question. I tried merging models but I can’t see where is the tokenizer.model file? How can you get it?

Yes, I used the dare branch, I also posted the yml file I used at the bottom of this model's card.

That's odd it didn't handle the tokenizer automatically, but if you copy the one from the base model into the new model's folder it should theoretically work.

wonderful, thank you. Really admire your work.

HoangHa changed discussion status to closed

Sign up or log in to comment