"libc++abi: terminating due to uncaught exception of type std::runtime_error: unexpectedly reached end of file"?
#3
by
FrankDMartinez
- opened
When trying to load a persistent session in llama.cpp with this model (q4_0), I get this error. I was using the model with llama.cpp until a few moments ago, had to Crtl+C because it seemed stuck repeating the same text over and over, tried restarting, and now get this error whenever I press .
Any suggestions on how I can resolve this issue?
Thanks in advance.
That error suggests that your q4_0 hasn't been downloaded properly. Delete it and try downloading again. I just tested the file and it works OK, so try grabbing it again.