Update README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,12 @@ We also have other two MiniCheck model variants:
|
|
| 28 |
|
| 29 |
|
| 30 |
### Model Performance
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
The performance of these models is evaluated on our new collected benchmark (unseen by our models during training), [LLM-AggreFact](https://huggingface.co/datasets/lytang/LLM-AggreFact),
|
| 32 |
from 10 recent human annotated datasets on fact-checking and grounding LLM generations. Our most capable model MiniCheck-Flan-T5-Large outperform all
|
| 33 |
exisiting specialized fact-checkers with a similar scale by a large margin (4-10% absolute increase) and is on par with GPT-4, but 400x cheaper. See full results in our work.
|
|
|
|
| 28 |
|
| 29 |
|
| 30 |
### Model Performance
|
| 31 |
+
|
| 32 |
+
<p align="center">
|
| 33 |
+
<img src="./cost-vs-bacc.png" width="360">
|
| 34 |
+
</p>
|
| 35 |
+
|
| 36 |
+
|
| 37 |
The performance of these models is evaluated on our new collected benchmark (unseen by our models during training), [LLM-AggreFact](https://huggingface.co/datasets/lytang/LLM-AggreFact),
|
| 38 |
from 10 recent human annotated datasets on fact-checking and grounding LLM generations. Our most capable model MiniCheck-Flan-T5-Large outperform all
|
| 39 |
exisiting specialized fact-checkers with a similar scale by a large margin (4-10% absolute increase) and is on par with GPT-4, but 400x cheaper. See full results in our work.
|