Hugging Face model: TheBloke/sonya-7B-x8-MoE-GPTQ
Author: TheBloke
Created: 2024-01-01 18:22:45
Last modified: 2024-01-01 22:56:29
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 4
Tags: transformers, safetensors, mixtral, text-generation, license:wtfpl, text-generation-inference, 4-bit, gptq, region:us
Card metadata:
base_model: dillfrescott/sonya-7b-x8-MoE
inference: no
license: wtfpl
model_creator: Cross Nastasi
model_name: Sonya 7B X8 MoE
model_type: mixtral
prompt_template: Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

quantized_by: TheBloke