Hugging Face model: FlorianJc/openchat-3.6-8b-20240522-vllm-fp8
Author: FlorianJc
Created: 2024-06-21 17:10:51
Last modified: 2024-07-17 17:01:40
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, safetensors, llama, text-generation, openchat, llama3, C-RLFT, vllm, fp8, conversational, arxiv:2309.11235, base_model:meta-llama/Meta-Llama-3-8B, base_model:quantized:meta-llama/Meta-Llama-3-8B, license:llama3, text-generation-inference, region:us
Base model relation: quantized
Base models: id: meta-llama/Meta-Llama-3-8B
Card metadata:
inference: no
quantized_by: FlorianJc
license: llama3
base_model: meta-llama/Meta-Llama-3-8B
tags: openchat, llama3, C-RLFT, vllm, fp8
library_name: transformers
pipeline_tag: text-generation