Broken NuSLERP

#1
by redrix - opened

Greetings!
I see you're facing issues in using NuSLERP, just like me. For me, I can't even merge a model, as it returns:

Input should be a valid dictionary or instance of GatherTensors [type=model_type, input_value=PermutedEmbeddings(gather...ride_architecture=None)), input_type=PermutedEmbeddings]

I see that your issue lies in quantizing. Perhaps something is wrong with how NuSLERP is generally set up by mergekit, since your model - and the one I'm working on right now - seem to be the first to use NuSLERP for Huggingface uploads. Perhaps it's something related to Pydantic or general hardware... (I use Fedora Linux)
Pretty unfortunate :/

Maybe... I just tried it with SLERP and it worked, albeit slightly lobotomized (but I think that's more my fault than mergekit's), but it worked. I think it's a mergekit problem too. Too bad.

redrix changed discussion status to closed

Awesome! I'll try and run this merge again and upload as v1.1

Sign up or log in to comment