How to use splits, 7z needed?
#1
by
ct-2
- opened
Do I need to join these files to a single file?
Yes. No 7z needed though, they're just simple byte splits now. The README will be added once they're all uploaded, but here's the principle:
Linux and macOS:
cat falcon-180b-chat.Q2_K.gguf-split-* > falcon-180b-chat.Q2_K.gguf && rm falcon-180b-chat.Q2_K.gguf-split-*
Windows command line:
COPY /B falcon-180b-chat.Q2_K.gguf-split-a + falcon-180b-chat.Q2_K.gguf-split-b falcon-180b-chat.Q2_K.gguf
del falcon-180b-chat.Q2_K.gguf-split-a falcon-180b-chat.Q2_K.gguf-split-b
4-bit and larger quants will split into three files not two. Possibly even four files for Q6_K.
great, thanks!
ct-2
changed discussion status to
closed