laion/tasktrove-dq-stack-pytest-step25-30b-a3b

tasktrove-dq-stack-pytest (step 25)

RL checkpoint from the TaskTrove data-quality sweep, trained with SkyRL from Qwen/Qwen3-Coder-30B-A3B-Instruct using RLOO over agentic software-engineering tasks executed by OpenCode in sandboxed environments.

• Base model: Qwen/Qwen3-Coder-30B-A3B-Instruct (Qwen3 MoE, 48 layers)
• Checkpoint: global_step_25
• Source run: rl-tasktrove-dq-sweep-30b-terminus2-qwen-20260725-155627-3eb19d
• Weights: 16 safetensors shards, 61.1 GB

What this is for

The sweep measures dataset quality, not model quality. Each arm trains the same base model on a different TaskTrove source so the sources can be compared. These checkpoints are research artifacts for that comparison. None has been evaluated as a general-purpose model, and no benchmark numbers are claimed here.

Training configuration

RLOO (advantage_estimator: rloo_n) with megatron backend, tensor-parallel 4, pipeline-parallel 2, expert-parallel 4, across 32 H100s. The objective is deliberately unregularized: use_kl_loss: false, use_entropy_loss: false, and policy_update_steps: 1, which leaves the PPO clip ratio inert at 0.0. That choice makes entropy dynamics the primary failure mode across the sweep, and it is why several arms ended early.

Provenance

Exported from a torch.distributed.checkpoint megatron checkpoint by re-running the trainer's own export path (bridge.save_hf_weights) at the checkpoint's own step, so no offline conversion was involved. Shard count, index total_size and weight_map completeness were verified against the object store before upload.