to add new command line parameter -gqa 8

#13
by TheVaccinator - opened

Hi,

I would like to inquire about the effective installation and usage of Llama-2-70B-Chat-GGML on my Mac with main

I apologize if my question appears straightforward.

Sign up or log in to comment