Can't deploy to any provider an inference endpoint

#9
by ejkkan - opened

Has anyone got it working via huggingface deployment?

NousResearch org

Do you use trust_remote_code=True

I'm having trouble deploying this to huggingface inference endpoints too. The error is:

NotImplementedError(\n\nNotImplementedError: rope scaling type yarn is not implemented or invalid

Sign up or log in to comment