NyistMilan
commited on
Commit
•
c0fd531
1
Parent(s):
552ce48
Added more information to README.
Browse files
README.md
CHANGED
@@ -21,4 +21,31 @@ tags:
|
|
21 |
|
22 |
# Model Card for Bert2Bert-HunSum-1
|
23 |
|
24 |
-
The Bert2Bert-HunSum-1 is a Hungarian summarization model, which was trained on the SZTAKI-HLT/HunSum-1 dataset.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
# Model Card for Bert2Bert-HunSum-1
|
23 |
|
24 |
+
The Bert2Bert-HunSum-1 is a Hungarian abstractive summarization model, which was trained on the [SZTAKI-HLT/HunSum-1 dataset](https://huggingface.co/datasets/SZTAKI-HLT/HunSum-1).
|
25 |
+
The model is based on [SZTAKI-HLT/hubert-base-cc](https://huggingface.co/SZTAKI-HLT/hubert-base-cc).
|
26 |
+
|
27 |
+
## Intended uses & limitations
|
28 |
+
|
29 |
+
- **Model type:** Text Summarization
|
30 |
+
- **Language(s) (NLP):** Hungarian
|
31 |
+
- **Resource(s) for more information:**
|
32 |
+
- [GitHub Repo](https://github.com/dorinapetra/summarization)
|
33 |
+
|
34 |
+
## Parameters
|
35 |
+
|
36 |
+
- **Batch Size:** 13
|
37 |
+
- **Learning Rate:** 5e-5
|
38 |
+
- **Weight Decay:** 0.01
|
39 |
+
- **Warmup Steps:** 16000
|
40 |
+
- **Epochs:** 15
|
41 |
+
- **no_repeat_ngram_size:** 3
|
42 |
+
- **num_beams:** 5
|
43 |
+
- **early_stopping:** True
|
44 |
+
|
45 |
+
## Results
|
46 |
+
|
47 |
+
| Metric | Value |
|
48 |
+
| :------------ | :------------------------------------------ |
|
49 |
+
| ROUGE-1 | 28.52 |
|
50 |
+
| ROUGE-2 | 10.35 |
|
51 |
+
| ROUGE-L | 20.07 |
|