Model: RedHatAI/gemma-2-9b-it-FP8
Author: RedHatAI
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, gemma2, text-generation, gemma, fp8, vllm, conversational, text-generation-inference, en, base_model:google/gemma-2-9b-it, base_model:quantized:google/gemma-2-9b-it, license:gemma, endpoints_compatible, region:us
Base models (quantized): id: google/gemma-2-9b-it
Card metadata: language: en
base_model: google/gemma-2-9b-it
pipeline_tag: text-generation
tags: gemma, gemma2, fp8, vllm, conversational, text-generation-inference
license: gemma
license_name: gemma
name: RedHatAI/gemma-2-9b-it-FP8
description: This model was obtained by quantizing the weights and activations of gemma-2-9b-it to FP8 data type.
readme: https://huggingface.co/RedHatAI/gemma-2-9b-it-FP8/main/README.md
tasks: text-to-text
provider: Google
license_link: https://ai.google.dev/gemma/terms
validated_on: RHOAI 2.20, RHAIIS 3.0, RHELAI 1.5
Likes: 5 | All-time downloads: 43213
Created: 2024-07-08 15:10:07