Hugging Face model: avtc/GLM-4.5-Air-GPTQMODEL-W8A16
Author: avtc
Created: 2025-12-01 04:08:21
Last modified: 2025-12-01 22:49:35
Pipeline: text-generation
Library: vllm
Likes: 2 | Downloads: 7
Tags: vllm, safetensors, glm4_moe, gptq, 8-bit, quantization, glm-4, moe, w8a16, text-generation, conversational, en, zh, dataset:allenai/c4, dataset:allenai/ai2_arc, dataset:openai/gsm8k, dataset:openai/openai_humaneval, dataset:tatsu-lab/alpaca, arxiv:2508.06471, base_model:zai-org/GLM-4.5-Air, base_model:quantized:zai-org/GLM-4.5-Air, license:mit, region:us
Base model relation: quantized
Base models: id: zai-org/GLM-4.5-Air
Card metadata:
language: en, zh
library_name: vllm
license: mit
pipeline_tag: text-generation
tags: gptq, 8-bit, quantization, glm-4, moe, w8a16, vllm
datasets: allenai/c4, allenai/ai2_arc, openai/gsm8k, openai/openai_humaneval, tatsu-lab/alpaca
base_model: zai-org/GLM-4.5-Air