qwen3-coder-30b-a3b

A tt-model container package: the serving platform ships as a Docker image, so a consumer needs only Docker and a Tenstorrent card — no tt-metal, no vLLM, no venv on the host.

Serve it

tt-model pull  raahemnabeel/qwen3-coder-30b-a3b
tt-model serve raahemnabeel/qwen3-coder-30b-a3b

Quickstart

Use it

An OpenAI-compatible server on http://127.0.0.1:8000. Point any OpenAI client at it with model id Qwen/Qwen3-Coder-30B-A3B-Instruct.

Serve profiles

One image serves every profile below; pick one with --profile.

profile	hardware	mesh	max_num_seqs	max_model_len
default (default)	p300x2	P300x2	32	256000

What is inside

• weights: Qwen/Qwen3-Coder-30B-A3B-Instruct — downloaded to your HF cache at pull time, never baked into the image
• arch: blackhole
• serving stack: vllm-plugin

Provenance

Everything below is pinned; the image was built from exactly these.

component	pinned to
tt-metal	435cc3638f7c6c9ff433139b3b01991e9bd53896
plugin	be7d8059957ad60752ccaf763c8eb0e2c394d7e1
code digest	acfe6577b9409d6e
built	2026-08-28T15:59:28+00:00 by tt-model 0.1.0

Shipped code

code/ in this repo is byte-identical to what runs inside the image.

• models/common/
• models/demos/blackhole/qwen3_coder_30b_a3b/