Hugging Face model: JunHowie/Qwen2-7B-Instruct-GPTQ-Int8
Author: JunHowie
Created: 2025-09-03 04:17:20
Last modified: 2025-09-03 10:15:32
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 7
Tags: transformers, safetensors, qwen2, text-generation, Qwen2, GPTQ, Int8, 量化修复, vLLM, conversational, arxiv:2309.00071, base_model:Qwen/Qwen2-7B-Instruct, base_model:quantized:Qwen/Qwen2-7B-Instruct, license:apache-2.0, text-generation-inference, endpoints_compatible, 8-bit, gptq, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen2-7B-Instruct
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen2-7B-Instruct/blob/main/LICENSE
pipeline_tag: text-generation
tags: Qwen2, GPTQ, Int8, 量化修复, vLLM
base_model: Qwen/Qwen2-7B-Instruct
base_model_relation: quantized