Gibberish with the most recent version of oobabooga web-ui
#14
by
IlyaSlez
- opened
Despite me reinstalling web-ui and the model itself 3 times in 3 different ways (one-click install web-ui + git clone model, one-click install web-ui + model installation through gui, manual install web-ui + model installation through gui) there are no apparent errors but the model outputs gibberish. The LLaMa 2 (7B-GPTTQ) by you works just fine although in the same installation of web-ui. I lack the skill and understanding to further debug the issue.
Platform: Linux, proprietary driver installed along with CUDA and working
GPU: NVidia GTX 1660 Ti (6GB)