Web UI loaded correctly but no response with Generate button pressed

#49
by pkr8 - opened

=========================
Windows Command:
python.exe server.py --model vicuna-13b-GPTQ-4bit-128g --auto-devices --wbits 4 --groupsize 128 --chat

Output:
INFO:Gradio HTTP request redirected to localhost :)
INFO:Loading vicuna-13b-GPTQ-4bit-128g...
INFO:Found the following quantized model: models\vicuna-13b-GPTQ-4bit-128g\vicuna-13b-4bit-128g.safetensors
INFO:Loaded the model in 3.46 seconds.

INFO:Loading the extension "gallery"...
Running on local URL: http://127.0.0.1:7860

Could not create share link. Please check your internet connection or our status page: https://status.gradio.app

input prompt but no response in WebUI, please help me check this out, THX!

vicuna.png

Sign up or log in to comment