How to try this model with Ooba's text-generation-webui?

#13

by rafa9 - opened Mar 11

rafa9

Mar 11

I keep running into CUDA out of memory or other exllama related issues when trying to run this in webui

rafa9 changed discussion status to closed Mar 11

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment