Chiboard-1 T2 DPO experiment 048 โ€” step 148

This is the strongest unpublished conventional DPO checkpoint from the Chiboard T2 experiments. It is public for reproducibility and comparison; the accepted production preview remains johnbean393/chiboard-1-t2-preview-0713.

The 1.2B model starts from Chiboard T1 and was trained for one epoch with FP32 DPO sequence-score accumulation, beta 0.1, and a chosen-answer NLL/RPO anchor of 2.0. It uses the immutable Chiboard v2 prompt format.

Frozen evaluation

Changes are percentage points. Higher EM is better; lower CER is better.

Slice EM vs T1 CER vs T1 EM vs accepted 0713 CER vs accepted 0713
Plain +0.08008 -0.00011 +0.03380 +0.00060
Revision +0.03715 -0.01586 -0.06907 -0.01365
Hard ambiguity +0.09315 -0.00037 +0.06512 +0.00059

It beat T1 on all six point metrics. Against the accepted 0713 checkpoint it improved three metrics, had +0.04233 pp combined utility, and a maximum adverse movement of 0.06907 pp. It was not promoted because the predeclared material gain required at least +0.10 pp utility.

Prompt format

<|startoftext|>{committed_context}<|reserved_6|>{raw_pinyin}<|reserved_7|>{display}<|reserved_8|>

Generate the converted active region greedily and stop at <|im_end|>.

Intended use and limitations

This checkpoint is intended for Chinese pinyin-to-Hanzi IME research and ablation comparisons. It is not the recommended Chiboard release. Small metric differences may not reproduce on a different sample, decoding policy, prompt serialization, or tokenizer. Use the accepted 0713 model when overall release quality matters.

Downloads last month
240
Safetensors
Model size
1B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for johnbean393/chiboard-1-t2-dpo-exp048-step148

Finetuned
(3)
this model