Hugging Face model: inference-optimization/Qwen3.5-397B-A17B-FP8-dynamic-mtp-head
Author: inference-optimization
Created: 2026-07-23 10:34:29
Last modified: 2026-07-23 10:36:49
Pipeline: image-text-to-text
Library: transformers
Likes: 0 | Downloads: 123
Tags: transformers, safetensors, qwen3_5_moe, image-text-to-text, fp8, vllm, llm-compressor, compressed-tensors, conversational, base_model:Qwen/Qwen3.5-397B-A17B, base_model:quantized:Qwen/Qwen3.5-397B-A17B, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3.5-397B-A17B
Card metadata:
library_name: transformers
pipeline_tag: image-text-to-text
tags: fp8, vllm, llm-compressor, compressed-tensors, qwen3_5_moe
base_model: Qwen/Qwen3.5-397B-A17B
name: RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic
license: apache-2.0
license_name: apache-2.0
description: 397B Qwen 3.5 MOE model with improved reasoning, tool calling, and VL capabilities, quantized to FP8.
readme: https://huggingface.co/RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic/main/README.md
license_link: https://huggingface.co/RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic/blob/main/LICENSE
provider: Alibaba Cloud
validated_on: RHOAI 3.4, RHAIIS 3.4, vLLM 0.18.0