Hugging Face model: TheBloke/prometheus-13B-v1.0-GPTQ
Author: TheBloke
Created: 2023-11-10 18:08:26
Last modified: 2023-11-10 18:54:58
Pipeline: text-generation
Library: transformers
Likes: 2 | Downloads: 12
Tags: transformers, safetensors, llama, text-generation, text2text-generation, en, dataset:kaist-ai/Feedback-Collection, arxiv:2310.08491, base_model:prometheus-eval/prometheus-13b-v1.0, base_model:quantized:prometheus-eval/prometheus-13b-v1.0, license:apache-2.0, text-generation-inference, 4-bit, gptq, region:us
Base model relation: quantized
Base models: id: prometheus-eval/prometheus-13b-v1.0
Card metadata:
base_model: kaist-ai/prometheus-13b-v1.0
datasets: kaist-ai/Feedback-Collection
inference: no
language: en
library_name: transformers
license: apache-2.0
metrics: pearsonr, spearmanr, accuracy
model_creator: KAIST AI
model_name: Prometheus 13B V1.0
model_type: llama
pipeline_tag: text2text-generation
prompt_template: ###Task Description:
An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
1. Write a detailed feedback that assess the quality of the response strictly based on the given score rubric, not evaluating in general.
2. After writing a feedback, write a score that is an integer between 1 and 5. You should refer to the score rubric.
3. The output format should look as follows: \"Feedback: (write a feedback for criteria) [RESULT] (an integer number between 1 and 5)\"
4. Please do not generate any other opening, closing, and explanations.

###The instruction to evaluate:
{prompt}

###Response to evaluate:
{{response}}

###Reference Answer (Score 5):
{{reference_answer}}

###Score Rubrics:
[{{criteria_description}}]
Score 1: {{score1_description}}
Score 2: {{score2_description}}
Score 3: {{score3_description}}
Score 4: {{score4_description}}
Score 5: {{score5_description}}

###Feedback:

quantized_by: TheBloke
tags: text2text-generation