Hugging Face model: TheBloke/bagel-34b-v0.2-AWQ
Author: TheBloke
Created: 2024-01-02 10:07:06
Last modified: 2024-01-02 11:20:32
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 13
Tags: transformers, safetensors, llama, text-generation, dataset:ai2_arc, dataset:unalignment/spicy-3.1, dataset:codeparrot/apps, dataset:facebook/belebele, dataset:boolq, dataset:jondurbin/cinematika-v0.1, dataset:drop, dataset:lmsys/lmsys-chat-1m, dataset:TIGER-Lab/MathInstruct, dataset:cais/mmlu, dataset:Muennighoff/natural-instructions, dataset:openbookqa, dataset:piqa, dataset:Vezora/Tested-22k-Python-Alpaca, dataset:cakiki/rosetta-code, dataset:Open-Orca/SlimOrca, dataset:spider, dataset:squad_v2, dataset:migtissera/Synthia-v1.3, dataset:datasets/winogrande, dataset:nvidia/HelpSteer, dataset:Intel/orca_dpo_pairs, dataset:unalignment/toxic-dpo-v0.1, dataset:jondurbin/truthy-dpo-v0.1, dataset:allenai/ultrafeedback_binarized_cleaned, dataset:Squish42/bluemoon-fandom-1-1-rp-cleaned, dataset:LDJnr/Capybara, dataset:JULIELab/EmoBank, dataset:kingbri/PIPPA-shareGPT, base_model:jondurbin/bagel-34b-v0.2, base_model:quantized:jondurbin/bagel-34b-v0.2, license:other, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: jondurbin/bagel-34b-v0.2
Card metadata:
base_model: jondurbin/bagel-34b-v0.2
datasets: ai2_arc, unalignment/spicy-3.1, codeparrot/apps, facebook/belebele, boolq, jondurbin/cinematika-v0.1, drop, lmsys/lmsys-chat-1m, TIGER-Lab/MathInstruct, cais/mmlu, Muennighoff/natural-instructions, openbookqa, piqa, Vezora/Tested-22k-Python-Alpaca, cakiki/rosetta-code, Open-Orca/SlimOrca, spider, squad_v2, migtissera/Synthia-v1.3, datasets/winogrande, nvidia/HelpSteer, Intel/orca_dpo_pairs, unalignment/toxic-dpo-v0.1, jondurbin/truthy-dpo-v0.1, allenai/ultrafeedback_binarized_cleaned, Squish42/bluemoon-fandom-1-1-rp-cleaned, LDJnr/Capybara, JULIELab/EmoBank, kingbri/PIPPA-shareGPT
inference: no
license: other
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
license_name: yi-license
model_creator: Jon Durbin
model_name: Bagel 34B v0.2
model_type: yi
prompt_template: Below is an instruction that describes a task.  Write a response that appropriately completes the request.

### Instruction:
{system_message}
{prompt}

### Response:

quantized_by: TheBloke