Qwen3-4B ShoppingBench SFT

Paper: arXiv:2606.10064
Code: https://github.com/ORO-AI/shoppingbench-trajectory-primitive

Supervised fine-tuning (SFT) of Qwen3-4B on the leak-cluster-guarded ShoppingBench SN15 corpus. This is the base SFT stage of the pipeline.

Companion artifact for the paper Bittensor Agent Arenas as a Trajectory Primitive: Distilling a Shopping Agent from ShoppingBench Subnet Traces. The published Qwen3-4B base scores 18.0% ASR on ShoppingBench; the distilled SFT-family models in this collection lift that to 42.7% on a leak-cluster-guarded held-out partition scored production-strict.

This is a merged full model (Qwen3-4B weights with the trained delta merged in), ready to load directly with transformers or serve with vLLM. No adapter stacking required.

Training data

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("oro-ai/qwen3-4b-shoppingbench-sft")
model = AutoModelForCausalLM.from_pretrained("oro-ai/qwen3-4b-shoppingbench-sft", torch_dtype="bfloat16", device_map="auto")

License

Apache-2.0, inherited from the Qwen3-4B base model.

Downloads last month
29
Safetensors
Model size
4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for oro-ai/qwen3-4b-shoppingbench-sft

Finetuned
Qwen/Qwen3-4B
Finetuned
(987)
this model

Collection including oro-ai/qwen3-4b-shoppingbench-sft

Paper for oro-ai/qwen3-4b-shoppingbench-sft