seungone commited on
Commit
3e14f27
1 Parent(s): fb83e8b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -15,6 +15,9 @@ metrics:
15
  ---
16
 
17
  # TL;DR
 
 
 
18
 
19
  Prometheus is a language model using [Llama-2-Chat](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) as a base model and fine-tuned on 100K feedback within the [Feedback Collection](https://huggingface.co/datasets/kaist-ai/Feedback-Collection).
20
  Since it was fine-tuned on a large amount of feedback, it is specialized at evaluating long-form responses, outperforming GPT-3.5-Turbo, Llama-2-Chat 70B, and on par with GPT-4 on various benchmarks.
 
15
  ---
16
 
17
  # TL;DR
18
+ Prometheus is an alternative of GPT-4 evaluation when doing fine-grained evaluation of a LLM & a Reward model for Reinforcement Learning from Human Feedback (RLHF).
19
+ ![plot](./finegrained_eval.JPG)
20
+
21
 
22
  Prometheus is a language model using [Llama-2-Chat](https://huggingface.co/meta-llama/Llama-2-13b-chat-hf) as a base model and fine-tuned on 100K feedback within the [Feedback Collection](https://huggingface.co/datasets/kaist-ai/Feedback-Collection).
23
  Since it was fine-tuned on a large amount of feedback, it is specialized at evaluating long-form responses, outperforming GPT-3.5-Turbo, Llama-2-Chat 70B, and on par with GPT-4 on various benchmarks.