Is the q4 version in ggml format?

by ai2p - opened Apr 14, 2023

ai2p

Apr 14, 2023

•

Suitable for llama.cpp?

ai2p changed discussion title from That 4q version is in ggml format? to Is the q4 version in ggml format? Apr 14, 2023

Apr 15, 2023

yes

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment