RLVE OPD teacher: 07-SharedSubstringCounting

Final weights from the original RLVE data-scaling experiment. Method: GRPO specialist. All actors were initialized freshly from DeepSeek-R1-Distill-Qwen-1.5B.

Training environments: 1, fixed balanced difficulty 0/1. Generation uses 1024 initial tokens plus the configured 128-token answer-forcing continuation.

Training cap: 4,000 rollouts; final checkpoint update: 499 (zero-based), corresponding to 4,000 training rollouts. Teachers stop at 4,000 rollouts or ID validation pass@1 >= 0.98. Validation uses 32 prompts and 8 responses per prompt every 50 updates. Validation samples do not count toward training budgets.

Training run: W&B. Group: data-scaling-v1-20261022-180018.

This repository contains model weights and tokenizer/config files; optimizer and dataloader state are absent. The environment list and original run settings are recorded in training_run.json, with the exact configuration in training_config.yaml.

Downloads last month
85
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for davidheineman/rlve-opd-teacher-R1Distill-007-SharedSubstringCounting-20261025

Finetuned
(844)
this model

Collection including davidheineman/rlve-opd-teacher-R1Distill-007-SharedSubstringCounting-20261025