strange output?
#1
by
Ukro
- opened
Me: hello
AI: ZE _CRE _syntax nost _ demand cant _ Mill Unec _ collabor _lease demand≠ _ & feedbackzyksyntax _ medi _ _ _qiERimonitz spellZE demand _ZEZE _ZE slope≠ fut millsyntax _ _ adaptZEsyntax..
When using anon8231489123_vicuna-13b-GPTQ-4bit-128g it is giving normal output.. Strange
What commit of the GPTQ GitHub are you using? If you're using the text-generation-webui you might have an older commit than this was made with which may be causing the problem.
That was the problem <3 thank you
Ukro
changed discussion status to
closed