Repository: allenai/reward-bench
Issue: Add Skywork-Reward-V2
Root cause: Unimplemented Feature Gap

Hi! We would like to add seven new reward models from the Skywork-Reward-V2 series to the RewardBench v2 leaderboard. All of them are sequence classifiers, just like our previous generation.

For evaluation, we recommend using a sequence length of 16,384, the maximum length used during training. We used the following command in our evaluation.

```shell
python scripts/run_v2.py \
    --model=Skywork/Skywork-Reward-V2-Llama-3.1-8B \
    --batch_size=8 \
    --max_length=16384
```

We kept all other settings at their default values, except for batch size and maximum length.

Below are our local evaluation results on RewardBench v2:

| Model                                                                                                           |   Average |   Factuality |   Precise IF |   Math |   Safety |   Focus |   Ties |
|:----------------------------------------------------------------------------------------------------------------|----------:|-------------:|-------------:|-------:|---------:|--------:|-------:|
| [Skywork/Skywork-Reward-V2-Qwen3-0.6B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-0.6B)             |      61.3 |         58.2 |         40   |   71.6 |     84.4 |    79.4 |   34   |
| [Skywork/Skywork-Reward-V2-Qwen3-1.7B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-1.7B)             |      68.3 |         65.8 |         45   |   72.7 |     89.1 |    88.5 |   48.7 |
| [Skywork/Skywork-Reward-V2-Qwen3-4B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-4B)                 |      75.5 |         77.3 |         46.2 |   73.2 |     92.2 |    96.6 |   67.4 |
| [Skywork/Skywork-Reward-V2-Qwen3-8B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-8B)                 |      78.2 |         79.8 |         49.1 |   77   |     94   |    96.4 |   72.9 |
| [Skywork/Skywork-Reward-V2-Llama-3.2-1B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.2-1B)         |      64.3 |         60.9 |         45.6 |   59.6 |     87.3 |    89.3 |   43.1 |
| [Skywork/Skywork-Reward-V2-Llama-3.2-3B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.2-3B)         |      74.7 |         76.2 |         45.6 |   69.4 |     93.1 |    96   |   67.7 |
| [Skywork/Skywork-Reward-V2-Llama-3.1-8B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.1-8B)         |      84.1 |         84.6 |         66.2 |   77.6 |     96.7 |    98.4 |   81.2 |

If the leaderboard for the first version of RewardBench is still active, we would like to add these results to the leaderboard as well. Below are the results for RewardBench v1:

| Model                                                                                                           |   Average |   Chat |   Chat Hard |   Safety |   Reasoning |
|:----------------------------------------------------------------------------------------------------------------|----------:|-------:|------------:|---------:|------------:|
| [Skywork/Skywork-Reward-V2-Qwen3-0.6B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-0.6B)             |      85.2 |   96.9 |        65.4 |     85.7 |        92.8 |
| [Skywork/Skywork-Reward-V2-Qwen3-1.7B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-1.7B)             |      90.3 |   98   |        75.4 |     90.8 |        96.9 |
| [Skywork/Skywork-Reward-V2-Qwen3-4B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-4B)                 |      93.4 |   97.8 |        83.8 |     93.6 |        98.5 |
| [Skywork/Skywork-Reward-V2-Qwen3-8B](https://huggingface.co/Skywork/Skywork-Reward-V2-Qwen3-8B)                 |      93.7 |   98.3 |        84.4 |     93.5 |        98.4 |
| [Skywork/Skywork-Reward-V2-Llama-3.2-1B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.2-1B)         |      89.9 |   97.5 |        75.4 |     92   |        94.5 |
| [Skywork/Skywork-Reward-V2-Llama-3.2-3B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.2-3B)         |      93   |   97.5 |        83.1 |     94.2 |        97.3 |
| [Skywork/Skywork-Reward-V2-Llama-3.1-8B](https://huggingface.co/Skywork/Skywork-Reward-V2-Llama-3.1-8B)         |      96.4 |   99.4 |        90.8 |     95.7 |        99.7 |

Thank you in advance!

Hi @chrisliu298 — we're very excited to see the new Skywork 2 series of reward models, great work! Thanks for contributing! Your models are now live on the version 2 leaderboard 🥳 !

<img width="2500" height="592" alt="Image" src="https://github.com/user-attachments/assets/daa7c591-fb66-4f91-a9e4-dd81ca301553" />

We currently don't have plans to actively update the v1 leaderboard, but will let you know if that changes