Random words and gibberish in text-generation-webui
#5
by
jacohend
- opened
Everything is loaded exactly as instructed. Using latest oobabooga master. Any easy pointers?
What is a falcon? Can I keep one as a pet?
### Response: lipids Rhys tomasignificant Koz swoich búsquруMaintenanceConsumerseryl chandelier�不janaeuropałaształ AntonFGisol Ep birthday birthdays Birthday celebrationMobilePresident overestibe distTribpoll poll pollpillar SOCtalboomBAGL ext Tar
That's odd, I've not had that reported before.
Are you manually specifying any GPTQ parameters? Can you show me a screenshot of your Models page in text-generation-webui.
Sure! No I think it's all defaults.
Sorry for the delay in getting back to you. If you're still having problems, can you try unticking desc_act - that should be set automatically from quantize_config.json and maybe it's causing problems.