Hugging Face model: canada-quant/hy3-w4a16-mtp
Author: canada-quant
Created: 2026-07-14 16:44:02
Last modified: 2026-07-17 18:13:48
Pipeline: text-generation
Library: vllm
Likes: 5 | Downloads: 2000
Tags: vllm, safetensors, hy_v3, hy3, hunyuan, w4a16, gptq, int4, compressed-tensors, moe, mixture-of-experts, mtp, speculative-decoding, llmcompressor, text-generation, conversational, en, zh, dataset:canada-quant/hy3-w4a16-mtp-calibration, dataset:ise-uiuc/Magicoder-OSS-Instruct-75K, dataset:openai/gsm8k, dataset:meta-math/MetaMathQA, dataset:HuggingFaceH4/ultrachat_200k, base_model:tencent/Hy3, base_model:quantized:tencent/Hy3, license:apache-2.0, region:us
Base model relation: quantized
Base models: id: tencent/Hy3
Card metadata:
license: apache-2.0
license_link: https://huggingface.co/tencent/Hy3/blob/main/LICENSE
language: en, zh
tags: hy3, hunyuan, w4a16, gptq, int4, compressed-tensors, moe, mixture-of-experts, mtp, speculative-decoding, llmcompressor
base_model: tencent/Hy3
pipeline_tag: text-generation
datasets: canada-quant/hy3-w4a16-mtp-calibration, ise-uiuc/Magicoder-OSS-Instruct-75K, openai/gsm8k, meta-math/MetaMathQA, HuggingFaceH4/ultrachat_200k
library_name: vllm