Hugging Face model: Inferless/Mixtral-8x7B-v0.1-int8-GPTQ
Author: Inferless
Created: 2024-01-11 07:46:02
Last modified: 2024-01-25 19:52:04
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 5
Tags: transformers, safetensors, mixtral, text-generation, vllm, GPTQ, en, base_model:mistralai/Mixtral-8x7B-v0.1, base_model:finetune:mistralai/Mixtral-8x7B-v0.1, license:apache-2.0, text-generation-inference, region:us
Base model relation: finetune
Base models: id: mistralai/Mixtral-8x7B-v0.1
Card metadata:
base_model: mistralai/Mixtral-8x7B-v0.1
inference: no
language: en
license: apache-2.0
model_creator: mistralai
model_name: Mixtral-8x7B
model_type: mixtral
prompt_template: 
system
{system_message}


user
{prompt}


assistant

quantized_by: Inferless
tags: mixtral, vllm, GPTQ