Q5KS and chatml, i dunno what is it (it happen with all qwen models)
@Cran-May
Tagging Cran here.Just to be sure check if you're running the latest version of KoboldCpp for inference.
Yeah, i use 1.75.2 version
Β· Sign up or log in to comment