WebShop-Qwen3-8B-GiGPO

A Qwen/Qwen3-8B policy trained as a multi-turn search agent (Search-R1 style) with Process-GRPO: a process reward model (Olmo-3-7B-Think verifier) scores each turn, with per-(group, turn-position) advantage normalization and verifier prompts that include the retrieved tool responses and the gold answer.

The model at the repository root is the final policy (training step 400). Intermediate checkpoints are provided under step_<STEP>/ subfolders.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

# Final model (repo root)
model = AutoModelForCausalLM.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO")
tokenizer = AutoTokenizer.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO")

# An intermediate checkpoint
model_step = AutoModelForCausalLM.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO", subfolder="step_20")

Checkpoints

Root: final policy at step 400.

  • step_20/ โ€” intermediate checkpoint at training step 20
  • step_40/ โ€” intermediate checkpoint at training step 40
  • step_60/ โ€” intermediate checkpoint at training step 60
  • step_80/ โ€” intermediate checkpoint at training step 80
  • step_100/ โ€” intermediate checkpoint at training step 100
  • step_120/ โ€” intermediate checkpoint at training step 120
  • step_140/ โ€” intermediate checkpoint at training step 140
  • step_160/ โ€” intermediate checkpoint at training step 160
  • step_180/ โ€” intermediate checkpoint at training step 180
  • step_200/ โ€” intermediate checkpoint at training step 200
  • step_220/ โ€” intermediate checkpoint at training step 220
  • step_240/ โ€” intermediate checkpoint at training step 240
  • step_260/ โ€” intermediate checkpoint at training step 260
  • step_280/ โ€” intermediate checkpoint at training step 280
  • step_300/ โ€” intermediate checkpoint at training step 300
  • step_320/ โ€” intermediate checkpoint at training step 320
  • step_340/ โ€” intermediate checkpoint at training step 340
  • step_360/ โ€” intermediate checkpoint at training step 360
  • step_380/ โ€” intermediate checkpoint at training step 380

Training summary (step 400)

  • Process-reward score mean โ‰ˆ 0.93
  • Searches per trajectory โ‰ˆ 2.6 (non-collapsed, diverse multi-search policy)
  • Training-batch accuracy โ‰ˆ 0.49
Downloads last month
88
Safetensors
Model size
8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for wckwan/WebShop-Qwen3-8B-GiGPO

Finetuned
Qwen/Qwen3-8B
Finetuned
(1997)
this model