Omkar2118/datasets huggingface dataset:
PRMBench_Preview

This is the official dataset for PRMBench. PRMBench is a benchmark dataset for evaluating process-level reward models (PRMs). It consists of 6,216 data instances, each containing a question, a solution process, and a modified process with errors. The dataset is designed to evaluate the ability of PRMs to identify fine-grained error types in the solution process. The dataset is annotated with error types and reasons for the errors, providing a comprehensive evaluation of PRMs.

Introducing paper: PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models