Model: ospatch/QwQ-32B-INT8-W8A8
Author: ospatch
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, qwen2, text-generation, int8, qwq, vllm, conversational, en, arxiv:2210.17323, base_model:Qwen/QwQ-32B, base_model:quantized:Qwen/QwQ-32B, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base models (quantized): id: Qwen/QwQ-32B
Card metadata: license: apache-2.0
library_name: transformers
language: en
base_model: Qwen/QwQ-32B
tags: int8, qwen2, qwq, vllm
base_model_relation: quantized
pipeline_tag: text-generation
Likes: 5 | All-time downloads: 3960
Created: 2025-03-13 20:18:24