Unable to run the model on Sagemaker with cpu instance.
#8
by
ltechno
- opened
Tried running this model with AWS Sagemaker. Have received the below error.
An error occurred (ModelError) when calling the InvokeEndpoint operation: Received client error (400) from primary with message "{ "code": 400, "type": "InternalServerException", "message": "Could not load model /.sagemaker/mms/models/OpenAssistant__oasst-sft-1-pythia-12b with any of the following classes: (\u003cclass \u0027transformers.models.auto.modeling_auto.AutoModelForCausalLM\u0027\u003e, \u003cclass \u0027transformers.models.gpt_neox.modeling_gpt_neox.GPTNeoXForCausalLM\u0027\u003e)." }
Tried with transformers 4.26.1 as well as latest version 4.28.0.