AlphaOxO/Qwen3-14B-NVFP4

Using Hardware

• CPU: AMD Ryzen Threadripper PRO 7995WX
• MB: GIGABYTE AI TOP TRX50
• GPU: RTX 5090*1
• RAM: RDIMM DDR5 5600 128GB*2

Using Software

• CUDA version: 13.0
• CUDA driver version: 580.95.05
• pyTorch: 2.10.0+cu130
• transformers: 5.3.0
• llmcompressor: 0.10.0.1
• vllm: 0.17.1

Backbone Model

Qwen/Qwen3-14B

Using Dataset

tatsu-lab/alpaca convert as chat template.

Compare

--	origin model(BF16)	Quantization(This Model)
leaderboard_gpqa	---	---
VRAM Usage	27.52 GiB	9.9 GiB