Running Inference on Azure VM

#19
by J812 - opened

Hello, I would like to run inference using this model on about 1000 pictures. I do not have a GPU on my local machine, so I would like to do that on an Azure VM. Could you please help me to figure out which series of Azure VMs specifically I should use, I don't need real time predictions.
So basically something that is not ultra expensive, relatively fast & have enough space for the model.
I appreciate your help in advance. Thanks

Use vllm

Sign up or log in to comment