Model: Inferless/Mixtral-8x7B-v0.1-int8-GPTQ
Author: Inferless
Pipeline: text-generation
Library: transformers
Tags: transformers, safetensors, mixtral, text-generation, vllm, GPTQ, en, base_model:mistralai/Mixtral-8x7B-v0.1, base_model:finetune:mistralai/Mixtral-8x7B-v0.1, license:apache-2.0, text-generation-inference, region:us
Base models (finetune): id: mistralai/Mixtral-8x7B-v0.1
Card metadata: base_model: mistralai/Mixtral-8x7B-v0.1
inference: no
language: en
license: apache-2.0
model-index: name: Mixtral-8x7B
model_creator: mistralai
model_name: Mixtral-8x7B
model_type: mixtral
prompt_template: 
system
{system_message}


user
{prompt}


assistant

quantized_by: Inferless
tags: mixtral, vllm, GPTQ
Likes: 2 | All-time downloads: 868
Created: 2024-01-11 07:46:02