Hugging Face model: VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-256-woft
Author: VPTQ-community
Created: 2024-10-03 10:44:57
Last modified: 2025-02-25 17:53:48
Likes: 2 | Downloads: 22
Tags: safetensors, qwen2, VPTQ, Quantized, Quantization, arxiv:2409.17066, base_model:Qwen/Qwen2.5-32B-Instruct, base_model:quantized:Qwen/Qwen2.5-32B-Instruct, license:other, vptq, region:us
Base model relation: quantized
Base models: id: Qwen/Qwen2.5-32B-Instruct
Card metadata:
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-32B-Instruct/blob/main/LICENSE
base_model: Qwen/Qwen2.5-32B-Instruct
base_model_relation: quantized
tags: VPTQ, Quantized, Quantization