Hugging Face model: JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int8
Author: JunHowie
Created: 2025-09-01 13:32:20
Last modified: 2025-09-04 02:21:26
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 2539
Tags: transformers, safetensors, qwen3, text-generation, Qwen3, GPTQ, Int8, 量化修复, vLLM, conversational, arxiv:2505.09388, base_model:Qwen/Qwen3-4B-Instruct-2507, base_model:quantized:Qwen/Qwen3-4B-Instruct-2507, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, gptq, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen3-4B-Instruct-2507
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507/blob/main/LICENSE
pipeline_tag: text-generation
tags: Qwen3, GPTQ, Int8, 量化修复, vLLM
base_model: Qwen/Qwen3-4B-Instruct-2507
base_model_relation: quantized