Hugging Face model: RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic
Author: RedHatAI
Created: 2026-03-03 17:04:03
Last modified: 2026-04-28 22:11:55
Pipeline: image-text-to-text
Library: transformers
Likes: 1 | Downloads: 1337
Tags: transformers, safetensors, qwen3_5_moe, image-text-to-text, fp8, vllm, llm-compressor, compressed-tensors, conversational, base_model:Qwen/Qwen3.5-122B-A10B, base_model:quantized:Qwen/Qwen3.5-122B-A10B, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3.5-122B-A10B
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3.5-122B-A10B/blob/main/LICENSE
pipeline_tag: image-text-to-text
validated_on: RHOAI 3.4, RHAIIS 3.4, vLLM 0.18.0
name: RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic
description: This model was obtained by quantizing the weights and activations of Qwen/Qwen3.5-122B-A10B to FP8 data type, ready for inference with vLLM.
readme: https://huggingface.co/RedHatAI/Qwen3.5-122B-A10B-FP8-dynamic/blob/main/README.md
tags: fp8, vllm, llm-compressor, compressed-tensors, qwen3_5_moe
base_model: Qwen/Qwen3.5-122B-A10B
provider: Alibaba Cloud