GGUF / GPTQ /GGML available - should help on less spec'd hardware / 2, 3, 4, 5, 6 and 8-bit GGUF models for CPU+GPU inference

#8
by johndpope - opened

Sign up or log in to comment