custom model not working

#627
by micrem73 - opened

Hi,
I cloned chat-ui to my space. If I instantiate the MODEL var with the proposed model - -- it works. If I change it with sineglossa/Minerva-7B-instruct-v1.0 it does not. When I enter a prompt, I get back a "fetch failed" error. Here is the log. How could I develop a chatbot with Minerva model??

fetch failed\n at node:internal/deps/undici/undici:13392:13\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async streamingRequest (file:///app/node_modules/@huggingface/inference/dist/index.js:317:20)\n at async textGenerationStream (file:///app/node_modules/@huggingface/inference/dist/index.js:715:3)\n at async generate (file:///app/build/server/chunks/_server.ts-da-3rbuu.js:530:20)\n at async textGenerationWithoutTitle (file:///app/build/server/chunks/_server.ts-da-3rbuu.js:679:3)\ncaused by: Error: connect ECONNREFUSED 127.0.0.1:8080\n at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1611:16)"},"msg":"fetch failed"}

Sign up or log in to comment