Garbled output in llama.cpp

#13
by spanielrassler - opened

I have the newest build of llama.cpp and tried running it against the two split files without merging them (which is supposed to work, right?) and while the output was words and sentences, they didn't make much sense. Any idea what I could be doing wrong or do the files need to be merged?

@spanielrassler I'll need more info, can you paste the full output or provide the log file? I tested all the quants in their split form and they all worked here.

Thanks for the quick response. I don't know what happened but after I just pulled the code again and merged the file using the merge tool it worked so it obviously wasn't your quants that were causing the problem. Thanks for your effort!

spanielrassler changed discussion status to closed

Sign up or log in to comment