TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch
pytorch
non-profit
AI & ML interests
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
Recent Activity
View all activity
Organization Card
Hugging Face 🤗 + PyTorch 🔥
models
13
pytorch/Phi-4-mini-instruct-AWQ-INT4
Text Generation
•
Updated
•
1.1k
•
1
pytorch/Phi-4-mini-instruct-FP8
Text Generation
•
Updated
•
1.2k
•
1
pytorch/Phi-4-mini-instruct-INT4
Text Generation
•
Updated
•
1.21k
pytorch/Qwen3-8B-AWQ-INT4
Text Generation
•
Updated
•
198
•
1
pytorch/Qwen3-8B-INT4
Text Generation
•
Updated
•
225
•
2
pytorch/Qwen3-32B-FP8
Text Generation
•
Updated
•
110
pytorch/gemma-3-12b-it-FP8
Image-Text-to-Text
•
Updated
•
57
pytorch/gemma-3-27b-it-FP8
Image-Text-to-Text
•
Updated
•
130
pytorch/gemma-3-27b-it-INT4
Image-Text-to-Text
•
Updated
•
89
pytorch/gemma-3-12b-it-INT4
Image-Text-to-Text
•
Updated
•
67
datasets
0
None public yet