Sagemaker Instance suggestion for Inference

#18
by LorenzoCevolaniAXA - opened

Hello,
I have been trying to use your model for creating embeddings.
At the moment I can see that whatever instance I use I run out of memory, even on a 192 GB instance I get a memory error... is there some problem with sagemaker?
Which instance do you suggest to use?

Thank you very much in advance

Sign up or log in to comment