Broken NuSLERP
Greetings!
I see you're facing issues in using NuSLERP, just like me. For me, I can't even merge a model, as it returns:
Input should be a valid dictionary or instance of GatherTensors [type=model_type, input_value=PermutedEmbeddings(gather...ride_architecture=None)), input_type=PermutedEmbeddings]
I see that your issue lies in quantizing. Perhaps something is wrong with how NuSLERP is generally set up by mergekit, since your model - and the one I'm working on right now - seem to be the first to use NuSLERP for Huggingface uploads. Perhaps it's something related to Pydantic or general hardware... (I use Fedora Linux)
Pretty unfortunate :/
Maybe... I just tried it with SLERP and it worked, albeit slightly lobotomized (but I think that's more my fault than mergekit's), but it worked. I think it's a mergekit problem too. Too bad.
The issue got fixed!
https://github.com/arcee-ai/mergekit/issues/472
Awesome! I'll try and run this merge again and upload as v1.1