Hugging Face's logo

AlphaOxO
/
Qwen3.6-27B-NVFP4

Image-Text-to-Text
Safetensors
qwen3_5
conversational
compressed-tensors
Model card Files
xet
 Community

Using Hardware

  • GIGABYTE AI Top Atom (GB10) 128G *1

Using Software

  • CUDA version: 13.0
  • CUDA driver version: 580.95.05
  • pyTorch: 2.10.0+cu130
  • transformers: 5.6.0
  • llmcompressor: 0.10.1+dev
  • vllm: 0.19.1

Backbone Model

Qwen/Qwen3.6-27B

Using Dataset

tatsu-lab/alpaca convert as chat template.

Compare

-- origin model(BF16) Quantization(This Model, NVFP4)
VRAM Usage 51.10 GiB 26.02 GiB
Downloads last month
7
Safetensors
Model size
19B params
Tensor type
F32
·
BF16
·
F8_E4M3
·
U8
·
Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AlphaOxO/Qwen3.6-27B-NVFP4

Base model

Qwen/Qwen3.6-27B
Quantized
(564)
this model

Dataset used to train AlphaOxO/Qwen3.6-27B-NVFP4

Collection including AlphaOxO/Qwen3.6-27B-NVFP4