Instructions to use wisdompan/qwen35-2b-mopd-mixsft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wisdompan/qwen35-2b-mopd-mixsft with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="wisdompan/qwen35-2b-mopd-mixsft") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("wisdompan/qwen35-2b-mopd-mixsft") model = AutoModelForMultimodalLM.from_pretrained("wisdompan/qwen35-2b-mopd-mixsft", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use wisdompan/qwen35-2b-mopd-mixsft with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "wisdompan/qwen35-2b-mopd-mixsft" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wisdompan/qwen35-2b-mopd-mixsft", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/wisdompan/qwen35-2b-mopd-mixsft
- SGLang
How to use wisdompan/qwen35-2b-mopd-mixsft with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "wisdompan/qwen35-2b-mopd-mixsft" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wisdompan/qwen35-2b-mopd-mixsft", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "wisdompan/qwen35-2b-mopd-mixsft" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wisdompan/qwen35-2b-mopd-mixsft", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use wisdompan/qwen35-2b-mopd-mixsft with Docker Model Runner:
docker model run hf.co/wisdompan/qwen35-2b-mopd-mixsft
Qwen3.5-2B MOPD MixSFT
This repository contains the full-parameter MixSFT initialization used for an Open-MOPD reproduction based on Qwen3.5-2B. It is intended as the common starting point for the Math, Code, and Instruction-Following teacher policies.
Status: MixSFT checkpoint, not the final MOPD student. Teacher RL and student distillation checkpoints will be published separately after they pass stability checks and evaluation.
基于 Qwen3.5-2B 的 MOPD 复现实验 MixSFT 初始化权重,覆盖数学、 代码和指令遵循数据。它不是最终 MOPD student;后续稳定的 teacher 和 student 权重会分阶段发布。
Model details
| Item | Value |
|---|---|
| Base model | Qwen/Qwen3.5-2B |
| Parameters | 1,881,825,088 |
| Fine-tuning | Full parameter supervised fine-tuning |
| Domains | Math, code, instruction following |
| Precision | bfloat16 |
| Context length used for SFT | 1,024 tokens |
| Checkpoint | 1 epoch / step 375 |
| Weight format | SafeTensors |
The checkpoint was trained with Adafactor, a cosine learning-rate schedule,
peak learning rate 1e-5, weight decay 0.1, gradient accumulation 8,
gradient checkpointing, and seed 20260902. The final recorded training loss
was 0.6251 and token accuracy was 0.8485.
Intended use
- Research on multi-domain reasoning and MOPD-style teacher/student training.
- Continued Math, Code, and Instruction-Following RL training.
- Local inference and controlled evaluation of this intermediate SFT stage.
This model is not presented as a production-ready assistant or as the final result of the MOPD experiment.
Quick start
Qwen3.5 requires a recent Transformers build. The serving flow follows the upstream Qwen3.5 recommendation:
pip install "transformers[serving] @ git+https://github.com/huggingface/transformers.git@main"
transformers serve \
--force-model wisdompan/qwen35-2b-mopd-mixsft \
--port 8000 \
--continuous-batching
Then call the OpenAI-compatible endpoint:
from openai import OpenAI
client = OpenAI(base_url="http://localhost:8000/v1", api_key="unused")
response = client.chat.completions.create(
model="wisdompan/qwen35-2b-mopd-mixsft",
messages=[{"role": "user", "content": "Solve: 2x + 3 = 11"}],
)
print(response.choices[0].message.content)
Evaluation status
Only a six-example pipeline sanity check was bundled with this checkpoint. It is useful for confirming that generation and reward routing work, but it is too small to report as a benchmark. Broader evaluation will accompany the final teacher and student releases.
Limitations
- This is an intermediate checkpoint and may produce incorrect, verbose, or unsafe content.
- Math, coding, and instruction-following quality has not yet been established on broad public benchmarks.
- Users should independently evaluate safety and task fitness before deployment.
Training lineage
Qwen/Qwen3.5-2B
-> MixSFT (this repository)
-> Math / Code / IF teacher RL
-> MOPD student distillation
License
This derivative is released under the Apache License 2.0, following the base model license. Users must also comply with the terms and usage requirements of the upstream Qwen3.5-2B model.
- Downloads last month
- -