openai/gsm8k
Benchmark • Updated • 17.6k • 1.06M • 1.57k
How to use ssurface/cot-dialect-olmo3-7b-think-conditioned-sft with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/Olmo-3-7B-Think")
model = PeftModel.from_pretrained(base_model, "ssurface/cot-dialect-olmo3-7b-think-conditioned-sft")The alternative design: one adapter asked to serve every verbosity level by naming the level in the prompt, instead of one adapter per level. This is the comparison that motivates the per-level family.
The SFT stage of the conditioned model. Numbers are reported for the GRPO stages, in the two companion repos.
| Stage | SFT (distillation), all levels in one corpus |
| Conditioning | the level is named in the prompt, not selected by adapter |
| Engine | HF transformers + peft |
| LoRA | r=16, alpha=32 |
| Hardware | 1x NVIDIA A100 80GB |
Solve this using Level {N} ({Verbose|Concise|Symbolic|Shorthand|Extreme}).
Problem: {your problem}
from transformers import AutoModelForCausalLM
from peft import PeftModel
model = AutoModelForCausalLM.from_pretrained("allenai/Olmo-3-7B-Think", torch_dtype="bfloat16", device_map="auto")
model = PeftModel.from_pretrained(model, "ssurface/cot-dialect-olmo3-7b-think-conditioned-sft")
Base model
allenai/Olmo-3-1025-7B