Model: RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8
Author: RedHatAI
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mixtral, text-generation, fp8, vllm, conversational, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata: tags: fp8, vllm
license: apache-2.0
Likes: 3 | All-time downloads: 30913
Created: 2024-04-25 21:12:44