Transformers
English
llama
text-generation-inference

was unable to load using text-generation-webui

#1
by LaferriereJC - opened

(It works on my machine)

It works on my machine too.

I'm getting gibberish!!!

I'm getting gibberish too. If it works for anyone can you provide what settings you choose etc?

I am using wizardlm-1.0-uncensored-llama2-13b.ggmlv3.q4_1.bin. It does work on my machine.

image.png

LaferriereJC changed discussion status to closed
LaferriereJC changed discussion status to open

adding more context

Sign up or log in to comment