Model: FlorianJc/google-gemma-2-9b-it-vllm-fp8
Author: FlorianJc
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, gemma2, text-generation, conversational, vllm, fp8, arxiv:2009.03300, arxiv:1905.07830, arxiv:1911.11641, arxiv:1904.09728, arxiv:1905.10044, arxiv:1907.10641, arxiv:1811.00937, arxiv:1809.02789, arxiv:1911.01547, arxiv:1705.03551, arxiv:2107.03374, arxiv:2108.07732, arxiv:2110.14168, arxiv:2009.11462, arxiv:2101.11718, arxiv:2110.08193, arxiv:1804.09301, arxiv:2109.07958, arxiv:1804.06876, arxiv:2103.03874, arxiv:2304.06364, arxiv:2206.04615, arxiv:2203.09509, license:gemma, text-generation-inference, region:us
Card metadata: inference: no
quantized_by: FlorianJc
license: gemma
library_name: transformers
pipeline_tag: text-generation
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_prompt: To access Gemma on Hugging Face, you’re required to review and agree to Google’s usage license. To do this, please ensure you’re logged in to Hugging Face and click below. Requests are processed immediately.
extra_gated_button_content: Acknowledge license
tags: conversational, vllm, fp8
Likes: 1 | All-time downloads: 2569
Created: 2024-07-06 18:49:54