chiboard-1-m0

Bootstrap 350M SFT model for Chiboard mistake mining.

Prompt format:

<|startoftext|>{committed_context}<|reserved_6|>{raw_pinyin}<|reserved_7|>{display}<|reserved_8|>{target}<|im_end|>

The model was trained with completion-only loss on {target}<|im_end|>.

Serve with exactly one <|startoftext|> token. Most runtimes add it automatically, so do not also embed it in the prompt string.

This is M0, a data-generation tool for typing-prefix replay; it is not the shipped final model.

Training

  • Base model: LiquidAI/LFM2.5-350M-Base
  • Dataset: johnbean393/chiboard-1-sft
  • Training layout: mixed_packed
  • Max packed length: 4096
  • Effective batch: 10 x 6 = 60 packed rows per optimizer step
  • Steps: 14746 / 14746
  • Final eval loss: 0.17373667657375336
  • Final eval mean token accuracy: 0.9519697650369391
  • Train runtime seconds: 3.506e+04
  • Packed LFM2 short-conv boundary isolation: seq_idx collator enabled
Downloads last month
385
Safetensors
Model size
0.4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for johnbean393/chiboard-1-m0

Finetuned
(16)
this model
Quantizations
1 model

Dataset used to train johnbean393/chiboard-1-m0