M3OPD-MOPD-9B

Student of multi-teacher on-policy distillation (MOPD) in the M3OPD-Reasoner recipe. It starts from Qwen3.5-9B and learns from the three domain teachers (image STEM, image perception, video) on its own responses to the prompts of M3OPD-RL-193K; each prompt goes to the teacher of its domain, and the loss is a top-32 reverse KL to that teacher. This is the final checkpoint (step 191, one epoch of the prompts).

All checkpoints of the recipe are in the M3OPD-Reasoner collection. The data are M3OPD-SFT-1.35M and M3OPD-RL-193K.

Usage

The model has the architecture, tokenizer, processor and chat template of Qwen3.5-9B, so it runs wherever Qwen3.5-9B runs (Transformers, vLLM, SGLang). We train and evaluate with the native Qwen3.5 chat template, thinking enabled, no system prompt, and one answer-format line after the question, for example Put your final answer within \boxed{}.

vllm serve ngqtrung/M3OPD-MOPD-9B --max-model-len 40960

License

Apache 2.0, the license of Qwen3.5-9B.

Downloads last month
16
Safetensors
Model size
9B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ngqtrung/M3OPD-MOPD-9B

Finetuned
Qwen/Qwen3.5-9B
Finetuned
(1,292)
this model

Datasets used to train ngqtrung/M3OPD-MOPD-9B

Collection including ngqtrung/M3OPD-MOPD-9B