Hugging Face model: TheBloke/bagel-8x7b-v0.2-AWQ
Author: TheBloke
Created: 2024-01-06 20:27:52
Last modified: 2024-01-06 20:58:52
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 9
Tags: transformers, safetensors, mixtral, text-generation, conversational, dataset:ai2_arc, dataset:jondurbin/airoboros-3.2, dataset:codeparrot/apps, dataset:facebook/belebele, dataset:boolq, dataset:jondurbin/cinematika-v0.1, dataset:drop, dataset:lmsys/lmsys-chat-1m, dataset:TIGER-Lab/MathInstruct, dataset:cais/mmlu, dataset:Muennighoff/natural-instructions, dataset:openbookqa, dataset:piqa, dataset:Vezora/Tested-22k-Python-Alpaca, dataset:cakiki/rosetta-code, dataset:Open-Orca/SlimOrca, dataset:spider, dataset:squad_v2, dataset:migtissera/Synthia-v1.3, dataset:datasets/winogrande, dataset:nvidia/HelpSteer, dataset:Intel/orca_dpo_pairs, dataset:unalignment/toxic-dpo-v0.1, dataset:jondurbin/truthy-dpo-v0.1, dataset:allenai/ultrafeedback_binarized_cleaned, dataset:Squish42/bluemoon-fandom-1-1-rp-cleaned, dataset:LDJnr/Capybara, dataset:JULIELab/EmoBank, dataset:kingbri/PIPPA-shareGPT, base_model:jondurbin/bagel-8x7b-v0.2, base_model:quantized:jondurbin/bagel-8x7b-v0.2, license:apache-2.0, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: jondurbin/bagel-8x7b-v0.2
Card metadata:
base_model: jondurbin/bagel-8x7b-v0.2
datasets: ai2_arc, jondurbin/airoboros-3.2, codeparrot/apps, facebook/belebele, boolq, jondurbin/cinematika-v0.1, drop, lmsys/lmsys-chat-1m, TIGER-Lab/MathInstruct, cais/mmlu, Muennighoff/natural-instructions, openbookqa, piqa, Vezora/Tested-22k-Python-Alpaca, cakiki/rosetta-code, Open-Orca/SlimOrca, spider, squad_v2, migtissera/Synthia-v1.3, datasets/winogrande, nvidia/HelpSteer, Intel/orca_dpo_pairs, unalignment/toxic-dpo-v0.1, jondurbin/truthy-dpo-v0.1, allenai/ultrafeedback_binarized_cleaned, Squish42/bluemoon-fandom-1-1-rp-cleaned, LDJnr/Capybara, JULIELab/EmoBank, kingbri/PIPPA-shareGPT
inference: no
license: apache-2.0
model_creator: Jon Durbin
model_name: Bagel 8X7B v0.2
model_type: mixtral
prompt_template: Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

quantized_by: TheBloke