Model: RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Author: RedHatAI
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mixtral, text-generation, fp8, vllm, conversational, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata: tags: fp8, vllm
license: apache-2.0
Likes: 3 | All-time downloads: 4804
Created: 2024-06-11 21:59:11