Hugging Face model: VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft
Author: VPTQ-community
Created: 2024-09-29 02:14:58
Last modified: 2025-03-20 03:10:28
Likes: 0 | Downloads: 5
Tags: safetensors, qwen2, VPTQ, Quantized, Quantization, arxiv:2409.17066, base_model:Qwen/Qwen2.5-7B-Instruct, base_model:quantized:Qwen/Qwen2.5-7B-Instruct, license:other, vptq, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen2.5-7B-Instruct
Card metadata:
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/blob/main/LICENSE
base_model: Qwen/Qwen2.5-7B-Instruct
base_model_relation: quantized
tags: VPTQ, Quantized, Quantization