Instructions to use Qwen/Qwen3-Omni-30B-A3B-Thinking with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Qwen/Qwen3-Omni-30B-A3B-Thinking with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Qwen/Qwen3-Omni-30B-A3B-Thinking") model = AutoModelForMultimodalLM.from_pretrained("Qwen/Qwen3-Omni-30B-A3B-Thinking", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Severe generation length bottleneck (hardcoded at 1024 tokens) in Qwen3OmniMoeForConditionalGeneration during greedy search / custom generation loop
#11 opened 2 months ago
by
ww997
When qwen3.6 omni??
👀 1
#10 opened 3 months ago
by
SylvainVerdy
404 Not Found when trying to retrieve pre-compiled wheel
#9 opened 7 months ago
by
josmith9873
vLLM serve for Qwen3-Omni currently only supports the thinker model.
👀 1
#8 opened 10 months ago
by
zhnagchenchne
How much vram?
1
#7 opened 11 months ago
by
yiki12
🚀 Best Practices for Evaluating the Qwen3-Omni Model
#5 opened 11 months ago
by
Yunxz
GUFF量化版本已發佈(INT8、FP16)
#4 opened 11 months ago
by
vito95311
量化版本已發佈(INT8+FP16)
#3 opened 11 months ago
by
vito95311
Local Installation Video and Testing - Step by Step
#1 opened 11 months ago
by
fahdmirzac