Hugging Face model: RedHatAI/gemma-4-31B-it-FP8-dynamic
Author: RedHatAI
Created: 2026-04-06 16:13:18
Last modified: 2026-08-07 19:32:33
Pipeline: image-text-to-text
Library: transformers
Likes: 23 | Downloads: 253408
Tags: transformers, safetensors, gemma4, image-text-to-text, fp8, vllm, llm-compressor, compressed-tensors, conversational, base_model:google/gemma-4-31B-it, base_model:quantized:google/gemma-4-31B-it, license:apache-2.0, endpoints_compatible, deploy:azure, region:us
Base model relation: quantized
Base models: id: google/gemma-4-31B-it
Card metadata:
tags: fp8, vllm, llm-compressor, compressed-tensors
library_name: transformers
license: apache-2.0
license_link: https://ai.google.dev/gemma/docs/gemma_4_license
pipeline_tag: image-text-to-text
base_model: google/gemma-4-31B-it
provider: Google
name: RedHatAI/gemma-4-31B-it-FP8-dynamic
description: FP8-dynamic variant of gemma-4-31B-it.
readme: https://huggingface.co/RedHatAI/gemma-4-31B-it-FP8-dynamic/blob/main/README.md
tool_calling_supported: yes
required_cli_args: --reasoning-parser gemma4, --enable-prefix-caching
default-chat-template-kwargs: enable_thinking: yes
chat_template_file_name: None
chat_template_path: None
tool_call_parser: gemma4
validated_tasks: tool-calling
tasks: text-to-text, text-generation, tool-calling
validated_on: RHOAI 3.5, RHAIIS 3.5, vLLM 0.24.0