It's not compatible with text generation webUI, what IS it compatible with?

#1
by AmBaseman - opened

Is there a way to run this on a PC, Nvidia 3060 6GB VRAM?

Right now? no way to run it anywhere, there will be a way in text-generation-webui when this PR gets merged: https://github.com/oobabooga/text-generation-webui/pull/1741

You can use via AUTOGPTQ.

Right now? no way to run it anywhere, there will be a way in text-generation-webui when this PR gets merged: https://github.com/oobabooga/text-generation-webui/pull/1741

Oh hey it works now! Thanks! I wonder if I can figure out how to have it use the webcam?

@wojtab https://github.com/oobabooga/text-generation-webui/pull/1741 this pr is merged, it should be compatible now. Would you like to update the README?

Sign up or log in to comment