kerasformers/qwen3-30b-a3b-base

Run Qwen3 with Keras 3: JAX, PyTorch, or TensorFlow

kerasformers/qwen3-30b-a3b-base

Pure-Keras 3 conversion of Qwen/Qwen3-30B-A3B-Base for kerasformers. One implementation runs unmodified on TensorFlow / Torch / JAX. This is a Mixture-of-Experts Qwen3; weights are stored in bfloat16.

For model details, license, and usage terms, see the upstream model card.

Paper: Qwen3 Technical Report (arXiv:2505.09388) · HF Papers

✨ Quick start

import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from kerasformers.models.qwen3_moe import Qwen3MoeTextGenerate, Qwen3MoeTokenizer

model = Qwen3MoeTextGenerate.from_weights("kerasformers/qwen3-30b-a3b-base")
tokenizer = Qwen3MoeTokenizer.from_weights("kerasformers/qwen3-30b-a3b-base")

inputs = tokenizer("Give me a short introduction to large language models.")
outputs = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(outputs[0]))

Special Thanks

A huge thank you to the Qwen team at Alibaba for creating and releasing these models.

License: Apache 2.0.