Text Generation
Transformers
Safetensors
qwen3
reinforcement-learning
grpo
search-r1
process-reward
tool-use
conversational
text-generation-inference
Instructions to use wckwan/WebShop-Qwen3-8B-GiGPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wckwan/WebShop-Qwen3-8B-GiGPO with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="wckwan/WebShop-Qwen3-8B-GiGPO") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO") model = AutoModelForCausalLM.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use wckwan/WebShop-Qwen3-8B-GiGPO with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "wckwan/WebShop-Qwen3-8B-GiGPO" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wckwan/WebShop-Qwen3-8B-GiGPO", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/wckwan/WebShop-Qwen3-8B-GiGPO
- SGLang
How to use wckwan/WebShop-Qwen3-8B-GiGPO with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "wckwan/WebShop-Qwen3-8B-GiGPO" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wckwan/WebShop-Qwen3-8B-GiGPO", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "wckwan/WebShop-Qwen3-8B-GiGPO" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wckwan/WebShop-Qwen3-8B-GiGPO", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use wckwan/WebShop-Qwen3-8B-GiGPO with Docker Model Runner:
docker model run hf.co/wckwan/WebShop-Qwen3-8B-GiGPO
WebShop-Qwen3-8B-GiGPO
A Qwen/Qwen3-8B policy trained as a multi-turn search agent (Search-R1 style) with Process-GRPO: a process reward model (Olmo-3-7B-Think verifier) scores each turn, with per-(group, turn-position) advantage normalization and verifier prompts that include the retrieved tool responses and the gold answer.
The model at the repository root is the final policy (training step 400).
Intermediate checkpoints are provided under step_<STEP>/ subfolders.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
# Final model (repo root)
model = AutoModelForCausalLM.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO")
tokenizer = AutoTokenizer.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO")
# An intermediate checkpoint
model_step = AutoModelForCausalLM.from_pretrained("wckwan/WebShop-Qwen3-8B-GiGPO", subfolder="step_20")
Checkpoints
Root: final policy at step 400.
step_20/โ intermediate checkpoint at training step 20step_40/โ intermediate checkpoint at training step 40step_60/โ intermediate checkpoint at training step 60step_80/โ intermediate checkpoint at training step 80step_100/โ intermediate checkpoint at training step 100step_120/โ intermediate checkpoint at training step 120step_140/โ intermediate checkpoint at training step 140step_160/โ intermediate checkpoint at training step 160step_180/โ intermediate checkpoint at training step 180step_200/โ intermediate checkpoint at training step 200step_220/โ intermediate checkpoint at training step 220step_240/โ intermediate checkpoint at training step 240step_260/โ intermediate checkpoint at training step 260step_280/โ intermediate checkpoint at training step 280step_300/โ intermediate checkpoint at training step 300step_320/โ intermediate checkpoint at training step 320step_340/โ intermediate checkpoint at training step 340step_360/โ intermediate checkpoint at training step 360step_380/โ intermediate checkpoint at training step 380
Training summary (step 400)
- Process-reward score mean โ 0.93
- Searches per trajectory โ 2.6 (non-collapsed, diverse multi-search policy)
- Training-batch accuracy โ 0.49
- Downloads last month
- 88