Hugging Face model: kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct
Author: kunhunjon
Created: 2026-06-07 17:34:36
Last modified: 2026-06-07 17:34:52
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 872
Tags: transformers, safetensors, gemma4_unified_assistant, text-generation, compressed-tensors, marlin, int4, speculative-decoding, mtp, sglang, conversational, base_model:google/gemma-4-12B-it-qat-q4_0-unquantized-assistant, base_model:quantized:google/gemma-4-12B-it-qat-q4_0-unquantized-assistant, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: text-generation
base_model: google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
tags: compressed-tensors, marlin, int4, speculative-decoding, mtp, sglang