Hugging Face model: FlorianJc/google-gemma-2-9b-it-vllm-fp8
Author: FlorianJc
Created: 2024-07-06 18:49:54
Last modified: 2024-07-17 16:58:38
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 17
Tags: transformers, safetensors, gemma2, text-generation, conversational, vllm, fp8, arxiv:2009.03300, arxiv:1905.07830, arxiv:1911.11641, arxiv:1904.09728, arxiv:1905.10044, arxiv:1907.10641, arxiv:1811.00937, arxiv:1809.02789, arxiv:1911.01547, arxiv:1705.03551, arxiv:2107.03374, arxiv:2108.07732, arxiv:2110.14168, arxiv:2009.11462, arxiv:2101.11718, arxiv:2110.08193, arxiv:1804.09301, arxiv:2109.07958, arxiv:1804.06876, arxiv:2103.03874, arxiv:2304.06364, arxiv:2206.04615, arxiv:2203.09509, license:gemma, text-generation-inference, region:us
Card metadata:
inference: no
quantized_by: FlorianJc
license: gemma
library_name: transformers
pipeline_tag: text-generation
extra_gated_heading: Access Gemma on Hugging Face
extra_gated_button_content: Acknowledge license
tags: conversational, vllm, fp8