danskgpt-v4-12b

A Danish fine-tune of google/gemma-4-12B-it, tuned to be strong on Danish understanding, knowledge and reasoning tasks. It is a text-only Gemma4ForCausalLM checkpoint in bf16. For an even stronger model see syvai/danskgpt-v4-31b.

Usage

The model uses Gemma-4's chat format — always go through apply_chat_template (or vLLM's chat) so the <|turn> / <turn|> markers are added correctly.

Transformers

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "syvai/danskgpt-v4-12b"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, dtype=torch.bfloat16, device_map="auto")

messages = [
    {"role": "user", "content": "Forklar kort, hvad fotosyntese er, og hvorfor det er vigtigt."},
]
inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
out = model.generate(inputs, max_new_tokens=512, do_sample=True, temperature=0.7, top_p=0.9)
print(tok.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))

vLLM

from vllm import LLM, SamplingParams

llm = LLM(model="syvai/danskgpt-v4-12b", dtype="bfloat16")
messages = [
    {"role": "user", "content": "Giv mig tre forslag til en hyggelig weekendtur i Jylland."},
]
out = llm.chat(messages, SamplingParams(temperature=0.7, top_p=0.9, max_tokens=512))
print(out[0].outputs[0].text)

More Danish prompt ideas: "Omskriv denne sætning, så den bliver mere formel: ...", "Opsummer teksten nedenfor i tre punkter på dansk: ...", "Er følgende anmeldelse positiv eller negativ? ...".

Training

danskgpt-v4-12b is a QLoRA fine-tune (rank 16, 4-bit NF4 base, bf16 compute) of google/gemma-4-12B-it, trained on Danish task data to strengthen Danish understanding, knowledge and reasoning.

Intended use & limitations

• Intended use: Danish NLP — classification, reading comprehension, knowledge/reasoning Q&A, NER, and general Danish assistant tasks.
• Limitations: As a task-tuned model, it can be more terse/decisive than the base on open-ended generation. It inherits the base model's biases and knowledge cutoff. Not intended for high-stakes use without human oversight.

License

Released under CC-BY-4.0, consistent with other SyvAI models. Use of the base model is additionally subject to Google's Gemma terms.