Hugging Face model: RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8
Author: RedHatAI
Created: 2024-04-25 21:12:44
Last modified: 2024-07-18 19:11:27
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 15
Tags: transformers, safetensors, mixtral, text-generation, fp8, vllm, conversational, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
tags: fp8, vllm
license: apache-2.0