Hugging Face model: JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int8
Author: JunHowie
Created: 2025-09-01 14:02:35
Last modified: 2025-09-04 04:16:46
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 7
Tags: transformers, safetensors, qwen3, text-generation, Qwen3, GPTQ, Int8, 量化修复, vLLM, conversational, arxiv:2505.09388, base_model:Qwen/Qwen3-4B-Thinking-2507, base_model:quantized:Qwen/Qwen3-4B-Thinking-2507, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, gptq, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3-4B-Thinking-2507
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-4B-Thinking-2507/blob/main/LICENSE
pipeline_tag: text-generation
tags: Qwen3, GPTQ, Int8, 量化修复, vLLM
base_model: Qwen/Qwen3-4B-Thinking-2507
base_model_relation: quantized