Qwen3-1.7B-Base-MBPP-GRPO

Qwen3-1.7B-Base finetuned with GRPO (TRL + vLLM, single H100 in a Daytona sandbox) on ~460 MBPP problems (train+validation+prompt splits). Reward: 1 if the generated code passes all unit tests, else 0.

200 steps, lr 1e-6, 8 prompts x 8 samples per step, 512 max completion tokens, no KL term.

Model MBPP test pass@1 (greedy, n=500)
Qwen3-1.7B-Base 52.0%
This model 57.0%

Prompt format: a plain-text problem plus first test, ending with an opened "```python" fence; generation stops at the closing fence. Small-scale experiment; the training set is small and gains may not generalize beyond MBPP-style tasks. Weights are fp32 as saved by the trainer.

Downloads last month
133
Safetensors
Model size
2B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for vedssharma/Qwen3-1.7B-Base-MBPP-GRPO

Finetuned
(503)
this model