Hugging Face model: RedHatAI/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Author: RedHatAI
Created: 2024-06-11 21:59:11
Last modified: 2024-08-12 04:14:40
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 7
Tags: transformers, safetensors, mixtral, text-generation, fp8, vllm, conversational, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
tags: fp8, vllm
license: apache-2.0