Spaces:

iAkashPaul
/

server.cpp

Running

iAkashPaul commited on Apr 29

Commit

0630f9d

•

1 Parent(s): b2a0119

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -10,4 +10,4 @@ WORKDIR /llama.cpp
 EXPOSE 7860
 RUN chmod -R 777 /llama.cpp
 RUN nproc
-CMD ./server --host 0.0.0.0 --port 7860 -t 3 -m ./models/Phi-3-mini-4k-instruct-q4.gguf

 EXPOSE 7860
 RUN chmod -R 777 /llama.cpp
 RUN nproc
+CMD ./server --host 0.0.0.0 --port 7860 -t 3 -m ./models/Phi-3-mini-4k-instruct-q4.gguf --parallel 2