Hugging Face model: RedHatAI/gemma-4-12B-it-NVFP4
Author: RedHatAI
Created: 2026-06-08 20:21:16
Last modified: 2026-08-07 20:17:54
Pipeline: any-to-any
Library: transformers
Likes: 4 | Downloads: 360286
Tags: transformers, safetensors, gemma4_unified, image-text-to-text, fp4, vllm, llm-compressor, compressed-tensors, any-to-any, base_model:google/gemma-4-12B-it, base_model:quantized:google/gemma-4-12B-it, license:apache-2.0, endpoints_compatible, 8-bit, region:us
Base model relation: quantized
Base models: id: google/gemma-4-12B-it
Card metadata:
library_name: transformers
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: any-to-any
base_model: google/gemma-4-12B-it
provider: Google
name: RedHatAI/gemma-4-12B-it-NVFP4
description: NVFP4 quantized variant of gemma-4-12B-it.
readme: https://huggingface.co/RedHatAI/gemma-4-12B-it-NVFP4/blob/main/README.md
tags: fp4, vllm, llm-compressor, compressed-tensors
tasks: text-to-text, text-generation, image-text-to-text, audio-text-to-text
validated_on: RHOAI 3.5, RHAIIS 3.5, vLLM 0.24.0