Model: FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8
Author: FlorianJc
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, llama, text-generation, vllm, fp8, nvidia, chatqa-1.5, chatqa, llama-3, pytorch, conversational, en, arxiv:2401.10225, license:llama3, text-generation-inference, region:us
Card metadata: inference: no
quantized_by: FlorianJc
license: llama3
language: en
pipeline_tag: text-generation
tags: vllm, fp8, nvidia, chatqa-1.5, chatqa, llama-3, pytorch
Likes: 0 | All-time downloads: 2441
Created: 2024-06-21 17:17:11