Hugging Face model: TheBloke/Mixtral_34Bx2_MoE_60B-GPTQ
Author: TheBloke
Created: 2024-01-08 10:42:12
Last modified: 2024-01-08 16:30:04
Pipeline: text-generation
Library: transformers
Likes: 7 | Downloads: 7
Tags: transformers, safetensors, mixtral, text-generation, base_model:cloudyu/Mixtral_34Bx2_MoE_60B, base_model:quantized:cloudyu/Mixtral_34Bx2_MoE_60B, license:cc-by-nc-4.0, text-generation-inference, 4-bit, gptq, region:us
Base model relation: quantized
Base models: id: cloudyu/Mixtral_34Bx2_MoE_60B
Card metadata:
base_model: cloudyu/Mixtral_34Bx2_MoE_60B
inference: no
license: cc-by-nc-4.0
model_creator: hai
model_name: Mixtral 34Bx2 MoE 60B
model_type: mixtral
prompt_template: {prompt}

quantized_by: TheBloke