Hugging Face model: RedHatAI/gemma-4-12B-it-FP8-Dynamic
Author: RedHatAI
Created: 2026-06-08 20:25:59
Last modified: 2026-08-07 19:54:31
Pipeline: any-to-any
Library: transformers
Likes: 3 | Downloads: 13625
Tags: transformers, safetensors, gemma4_unified, image-text-to-text, fp8, vllm, llm-compressor, compressed-tensors, any-to-any, base_model:google/gemma-4-12B-it, base_model:quantized:google/gemma-4-12B-it, license:apache-2.0, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: google/gemma-4-12B-it
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: any-to-any
base_model: google/gemma-4-12B-it
provider: Google
name: RedHatAI/gemma-4-12B-it-FP8-Dynamic
description: FP8-dynamic quantized variant of gemma-4-12B-it.
readme: https://huggingface.co/RedHatAI/gemma-4-12B-it-FP8-Dynamic/blob/main/README.md
tags: fp8, vllm, llm-compressor, compressed-tensors
tasks: text-to-text, text-generation, image-text-to-text, audio-text-to-text
validated_on: RHOAI 3.5, RHAIIS 3.5, vLLM 0.24.0