Deployment in dedicated endpoint failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error
#34
by
sck
- opened
Here is the screenshot for error message logs. Kindly help with how to fix this.
sck
changed discussion title from
Deployment failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error
to Deployment in dedicated endpoint failing with `Please pass the argument `trust_remote_code=True` to allow custom code to be run.` error
Also have seen this issue when trying the serverless deployment:
{'error': 'The repository for microsoft/Phi-3-mini-128k-instruct contains custom code which must be executed to correctly load the model. You can inspect the repository content at https://hf.co/microsoft/Phi-3-mini-128k-instruct.\nPlease pass the argument trust_remote_code=True to allow custom code to be run.'}
If I am not mistaken, it will only work when a new version of transformers is released (due to the internal support of phi-3 instead of relying on the modeling files in this repository).
gugarosa
changed discussion status to
closed