Deployment in dedicated endpoint failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error

#34
by sck - opened

Here is the screenshot for error message logs. Kindly help with how to fix this.
image.png

sck changed discussion title from Deployment failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error to Deployment in dedicated endpoint failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error

Also have seen this issue when trying the serverless deployment:
{'error': 'The repository for microsoft/Phi-3-mini-128k-instruct contains custom code which must be executed to correctly load the model. You can inspect the repository content at https://hf.co/microsoft/Phi-3-mini-128k-instruct.\nPlease pass the argument trust_remote_code=True to allow custom code to be run.'}

Microsoft org

If I am not mistaken, it will only work when a new version of transformers is released (due to the internal support of phi-3 instead of relying on the modeling files in this repository).

gugarosa changed discussion status to closed

Sign up or log in to comment