q8 request

#1
by dkjsnnr1 - opened

Hey, it would be great having an 8bit quantized version of the orca_mini_v2_ger_7b-GGML available. πŸ™Œ

Sign up or log in to comment