Hugging Face model: ospatch/QwQ-32B-INT8-W8A8
Author: ospatch
Created: 2025-03-13 20:18:24
Last modified: 2025-03-13 23:12:42
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 11
Tags: transformers, safetensors, qwen2, text-generation, int8, qwq, vllm, conversational, en, arxiv:2210.17323, base_model:Qwen/QwQ-32B, base_model:quantized:Qwen/QwQ-32B, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, compressed-tensors, region:us
Base model relation: quantized
Base models: id: Qwen/QwQ-32B
Card metadata:
license: apache-2.0
library_name: transformers
language: en
base_model: Qwen/QwQ-32B
tags: int8, qwen2, qwq, vllm
base_model_relation: quantized
pipeline_tag: text-generation