Access Qwen3.5-StepFun-Mix

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

By requesting access, you agree to the Qwen3.5-StepFun-Mix License, including noncommercial use of our fine-tuning contributions, and acknowledge the StepFun data terms linked in the model card. The model is provided as is, without warranty.

Log in or Sign Up to review the conditions and access this model content.

Qwen3.5-StepFun-Mix

Public-data comparison for WebUniverse.

Qwen3.5-StepFun-Mix is a fine-tuned Qwen3.5-35B-A3B model for agentic web development.

Training data

We trained this comparison model on StepFun-Mix, our 15,000-example subset of StepFun's Step-3.5-Flash-SFT, selected from json/general/:

Component Examples
Front-end webpage generation 13,500
Multi-turn software engineering 1,500

We filtered and deduplicated the examples, screened for evaluation overlap, and converted them to our training format. The model uses the same base checkpoint and training configuration as Qwen3.5-WebUniverse. StepFun-Mix names our selected subset; the source corpus was released by StepFun.

Training configuration

Setting Value
Base model Qwen3.5-35B-A3B
Framework Megatron-LM through ms-swift
Epochs 2
Global batch size 16
Learning rate 2e-5
Schedule Cosine decay, 10% warmup
Packed sequence length 98,304 tokens
Input length limit 106,496 tokens
Precision BF16
Vision tower Frozen

Evaluation results

Model Vision2Web L1 average WebGen-Bench overall (%) Web-Bench pass@1 (%) Web-Bench pass@2 (%)
Qwen3.5-35B-A3B 51.7 34.5 7.2 12.2
Qwen3.5-StepFun-Mix 52.4 31.5 9.3 17.7

Evaluated with OpenCode benchmark adapters and vLLM 0.24.0, using temperature 0.6, top-p 0.95, and top-k 20.

Evaluation code and full configurations will be released with the project code.

Quick start

Tested with vLLM 0.24.0:

vllm serve WebUniverse-NSL/Qwen3.5-StepFun-Mix \
  --host 127.0.0.1 \
  --port 8000 \
  --served-model-name Qwen3.5-StepFun-Mix \
  --tensor-parallel-size 8 \
  --max-model-len 98304 \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice \
  --tool-call-parser qwen3_coder

Adjust tensor parallelism and context length to your GPU memory. See the base model documentation for serving details.

Resources

Resource Location
Training data source Step-3.5-Flash-SFT
WebUniverse comparison dataset WebUniverse-Mix
Models WebUniverse Models
Task environments WebUniverse-Env: executable tasks, initial workspaces, and verifiers

Attribution and license

CC BY-NC 2.0 for our fine-tuning contributions; Apache-2.0 for the base model. Trained on a subset of StepFun's Step-3.5-Flash-SFT, whose data terms require both Apache-2.0 and CC BY-NC 2.0.

Downloads last month
4
Safetensors
Model size
35B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for WebUniverse-NSL/Qwen3.5-StepFun-Mix

Finetuned
(182)
this model

Dataset used to train WebUniverse-NSL/Qwen3.5-StepFun-Mix

Collection including WebUniverse-NSL/Qwen3.5-StepFun-Mix