Cant get it to work within TextGenerationWebUI

#1
by MrToon - opened

Tried different approaches, and tried both the 4 and 5 model.
Also tried merging them with the famous cat multiple files > file.gguf method.
But all result in errors and warnings about a corrupted model.

Any help would be appreciated, I cant really find good info about the mentioned gguf-split.
People are saying that I shouldn't use this tool anymore.

gguf-split is part of llama.cpp

Sign up or log in to comment