inference speed is considerably slow

#11

by sonald - opened Aug 10, 2023

sonald

Aug 10, 2023

compare to ther 13B models, this model is quite slow, any ideas on why ?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment