abhik1505040
commited on
Commit
•
76b135c
1
Parent(s):
c3a6a2b
Update README.md
Browse files
README.md
CHANGED
@@ -34,16 +34,22 @@ print(decoded_tokens)
|
|
34 |
|
35 |
* Supervised fine-tuning
|
36 |
|
37 |
-
| Model | Params | MT (SacreBLEU) |
|
38 |
-
|
39 |
-
|[mT5 (base)](https://huggingface.co/google/mt5-base) | 582M | 36.6/22.5 | 10.
|
40 |
-
|[
|
|
|
|
|
|
|
41 |
|
42 |
|
43 |
The benchmarking datasets are as follows:
|
44 |
-
* **MT:** **[Machine Translation]()**
|
45 |
-
* **
|
46 |
-
* **QA:** **[Question Answering]()**
|
|
|
|
|
|
|
47 |
|
48 |
## Citation
|
49 |
|
|
|
34 |
|
35 |
* Supervised fine-tuning
|
36 |
|
37 |
+
| Model | Params | MT (SacreBLEU) | TS (ROUGE-2) | QA (EM/F1) | MD (SacreBLEU-1) | NHG (ROUGE-2) | XLS (ROUGE-2) | BNLG score |
|
38 |
+
|--------------------|------------|-----------------------|------------------------|-------------------|--------------------|----------------|----------------|---------------|
|
39 |
+
|[mT5 (base)](https://huggingface.co/google/mt5-base) | 582M | 36.6/22.5 | 10.3 | 59.0/65.3 | 17.5 | 9.6 | 2.7/0.7 | 24.9 |
|
40 |
+
|[XLM-ProphetNet](https://huggingface.co/microsoft/xprophetnet-large-wiki100-cased) | 616M | 23.3/16.4 | 7.8 | 53.0/57.3 | 20.0 | 9.5 | 6.2/2.7 | 21.8 |
|
41 |
+
|[mBART-50](https://huggingface.co/facebook/mbart-large-50) | 611M | 23.6/16.7 | 10.4 | 53.4/58.9 | 18.5 | 11.2 | 5.4/3.7 | 22.4 |
|
42 |
+
|[IndicBART](https://huggingface.co/ai4bharat/IndicBART) | 244M | 22.7/13.1 | 8.1 | 53.3/58.8 | 14.8 | 7.9 | 6.3/2.5 | 20.8 |
|
43 |
+
|[BanglaT5](https://huggingface.co/csebuetnlp/banglat5) | 247M | 38.8/25.2 | 13.7 | 68.5/74.8 | 19.0 | 13.8 | 6.4/4.0 | 29.4 |
|
44 |
|
45 |
|
46 |
The benchmarking datasets are as follows:
|
47 |
+
* **MT:** **[Machine Translation](https://github.com/csebuetnlp/banglanmt#datasets)**
|
48 |
+
* **TS:** **[Abstractive Text Summarization](https://huggingface.co/datasets/csebuetnlp/xlsum)**
|
49 |
+
* **QA:** **[Question Answering](https://huggingface.co/datasets/csebuetnlp/squad_bn)**
|
50 |
+
* **MD:** **[Multi Turn Dialogue Generation](https://drive.google.com/file/d/1qPmNN6qA4evbh4cD_BDDTCFOwMu4H2JS/view?usp=sharing)**
|
51 |
+
* **NHG:** **[News Headline Generation](https://huggingface.co/datasets/csebuetnlp/xlsum)**
|
52 |
+
* **XLS:** **[Cross-lingual Summarization](https://huggingface.co/datasets/csebuetnlp/CrossSum)**
|
53 |
|
54 |
## Citation
|
55 |
|