DavidAU

/

Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

like 13

I am going to assume the Instruct template is CommandR, according do Kobold this is:

System Tag:
<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|>

User Tag:
<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>

Assistant Tag:
<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>

correct 100%!

Thanks. What about Temperature, TopP and other paramters?

You can use default samplers,
IE: Temp .8 , top_p: .95, top_k: 40 ; min_p:.05 ; REP PEN: 1.1
(these are LMStudio defaults, TextGen UI will have similar)