It seems like not runnable on ollama...
#7
by
DXBTR74
- opened
As I tried many quants of this model and it popped error like this:
Error: error reading llm response: read tcp 127.0.0.1:52284->127.0.0.1:52281: wsarecv: An existing connection was forcibly closed by the remote host.
This only happened on this model including 0.15b, 0.4b and 1.7b. no matter what quants.
So is there any feasible way to run it?