Hugging Face model: RedHatAI/gemma-2-9b-it-FP8
Author: RedHatAI
Created: 2024-07-08 15:10:07
Last modified: 2026-06-09 17:45:22
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 505
Tags: transformers, safetensors, gemma2, text-generation, gemma, fp8, vllm, conversational, text-generation-inference, en, base_model:google/gemma-2-9b-it, base_model:quantized:google/gemma-2-9b-it, license:gemma, endpoints_compatible, region:us
Base model relation: quantized
Base models: id: google/gemma-2-9b-it
Card metadata:
language: en
base_model: google/gemma-2-9b-it
pipeline_tag: text-generation
tags: gemma, gemma2, fp8, vllm, conversational, text-generation-inference
license: gemma
license_name: gemma
name: RedHatAI/gemma-2-9b-it-FP8
description: This model was obtained by quantizing the weights and activations of gemma-2-9b-it to FP8 data type.
readme: https://huggingface.co/RedHatAI/gemma-2-9b-it-FP8/main/README.md
tasks: text-to-text
provider: Google
license_link: https://ai.google.dev/gemma/terms
validated_on: RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5, vLLM 0.8.4