Hugging Face's logo

DISLab
/
SummLlama3.1-8B

Summarization
Transformers
Safetensors
llama
text-generation
text-generation-inference
Inference Endpoints
Model card Files Community
Hwanjun commited on
Commit
bafb080
•
1 Parent(s): a0d271b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -24,8 +24,12 @@ This is automated evaluation results:
24
 
25
  | **Config.** | **Faithfulness** | **Completeness** | **Conciseness** | **Average** |
26
  |--------------------|------------|-----------|-----------|----------|
 
 
27
  | Llama3.1-8B-Instruct | 0.875 | 0.596 | 0.395 | 0.622 |
28
- | SummLlama3.-8B | 0.924 | 0.635 | 0.661 | 0.740 |
29
-
 
 
30
 
31
  Please refer to [our paper](https://arxiv.org/abs/2410.13116) to catch up how to exploit LLM-generated feedback in the context of text summarization.
 
24
 
25
  | **Config.** | **Faithfulness** | **Completeness** | **Conciseness** | **Average** |
26
  |--------------------|------------|-----------|-----------|----------|
27
+ | Llama3-8B-Instruct | 0.864 | 0.583 | 0.450 | 0.632 |
28
+ | Llama3-70B-Instruct | 0.931 | 0.596 | 0.487 | 0.671 |
29
  | Llama3.1-8B-Instruct | 0.875 | 0.596 | 0.395 | 0.622 |
30
+ | GPT-4o | 0.940 | 0.657 | 0.437 | 0.678 |
31
+ | SummLlama3-8B | 0.931 | 0.614 | 0.659 | 0.735 |
32
+ | SummLlama3-70B | 0.950 | 0.632 | 0.754 | 0.779 |
33
+ | **SummLlama3.1-8B** | 0.924 | 0.635 | 0.661 | 0.740 |
34
 
35
  Please refer to [our paper](https://arxiv.org/abs/2410.13116) to catch up how to exploit LLM-generated feedback in the context of text summarization.