Spaces:

ggml-org
/

gguf-my-repo

Running on A10G

Split/shard support

#64

by SixOpen - opened May 18

←

Files changed (1) hide show

start.sh CHANGED Viewed

@@ -1,4 +1,4 @@
 cd llama.cpp
-make -j quantize
 cd ..
 python app.py

 cd llama.cpp
+make -j quantize gguf-split
 cd ..
 python app.py