File size: 1,070 Bytes
014b14c 74b39bc 014b14c 74b39bc 014b14c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | ---
license: mit
task_categories: [text-generation]
tags: [math, process-verification, ProcessBench, PRM800K, mathcompose]
---
# mathcompose — Model V (process verifier) SFT data
First-error-localization critiques for training a small generative math verifier.
Each row: a problem + a step-indexed candidate solution (`prompt`) and a
paragraph-by-paragraph critique ending in `\boxed{{k}}` (`completion`), where `k`
is the 0-based index of the first erroneous step (`-1` = all correct).
- **Labels** are ground truth from **PRM800K** (OpenAI, MIT).
- **Genuine-detection recipe:** **claude-opus-4-8** critiques each solution *blind*
(never shown the answer); a critique is kept only if its predicted index matches
the PRM800K gold (rejection sampling, ~77% keep-rate). So the critiques contain
real error-finding reasoning, not rationalization.
- **Deduped** against ProcessBench + MATH-500 (no eval contamination).
- Naturally ~50/50 erroneous/all-correct (no rebalancing needed).
Built by the mathcompose harness. Eval target: ProcessBench first-error F1.
|