bartowski

/

google_gemma-3-27b-it-GGUF

like 42

I had strange behaviour in Ollama. Setting Modelfile params to below is fixing it (based on ollama model page):

FROM google_gemma-3-27b-it-IQ4_XS.gguf
PARAMETER stop "<end_of_turn>"
PARAMETER temperature 0.1
TEMPLATE """{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1 }}
{{- if or (eq .Role "user") (eq .Role "system") }}<start_of_turn>user
{{ .Content }}<end_of_turn>
{{ if $last }}<start_of_turn>model
{{ end }}
{{- else if eq .Role "assistant" }}<start_of_turn>model
{{ .Content }}{{ if not $last }}<end_of_turn>
{{ end }}
{{- end }}
{{- end }}"""