Any example of batch inference?

#46

by PrintScr - opened Oct 20, 2023

Oct 20, 2023

Hey!

I am looking for a more optimized way of running this model against a larger dataset of inputs.

Is there are a way to provide batched input into the model? Do you have any examples?

Thanks!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment