janhq

/

trinity-v1-GGUF

like 10

Follow

Jan 130

Hello I have few questions
I have to set the following settings :
max_total_tokens

• n_gpu_layers
• n_batch
• rope_freq_base
• rope_freq_scale

could you give the optimal one please

thanks for your job