Text Generation
Transformers
PyTorch
mpt
Composer
MosaicML
llm-foundry
conversational
custom_code
text-generation-inference

Sagemaker endpoint inference script help?

#3
by varuntejay - opened

Have anyone tried to deploy this model in AWS sagemaker, if say so, can you please help us with the inference script for the same

@varuntejay Hi! Were you able to implement the sagemaker endpoint?

Sign up or log in to comment