Hugging Face model: FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8
Author: FlorianJc
Created: 2024-06-21 17:17:11
Last modified: 2024-07-17 16:57:47
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, vllm, fp8, nvidia, chatqa-1.5, chatqa, llama-3, pytorch, conversational, en, arxiv:2401.10225, license:llama3, text-generation-inference, region:us
Card metadata:
inference: no
quantized_by: FlorianJc
license: llama3
language: en
pipeline_tag: text-generation
tags: vllm, fp8, nvidia, chatqa-1.5, chatqa, llama-3, pytorch