Hugging Face model: TheBloke/sonya-medium-x8-MoE-GPTQ
Author: TheBloke
Created: 2024-01-06 23:37:17
Last modified: 2024-01-07 03:18:37
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 8
Tags: transformers, safetensors, mixtral, text-generation, license:wtfpl, text-generation-inference, 4-bit, gptq, region:us
Card metadata:
base_model: dillfrescott/sonya-medium-x8-MoE
inference: no
license: wtfpl
model_creator: Cross Nastasi
model_name: Sonya Medium x8 MoE
model_type: mixtral
prompt_template: Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

quantized_by: TheBloke