abhik1505040 commited on
Commit
76b135c
1 Parent(s): c3a6a2b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -7
README.md CHANGED
@@ -34,16 +34,22 @@ print(decoded_tokens)
34
 
35
  * Supervised fine-tuning
36
 
37
- | Model | Params | MT (SacreBLEU) | ATS (ROUGE-2) | QA (EM/F1) | BNLG score |
38
- |--------------------|------------|-----------------------|------------------------|-------------------|--------------|
39
- |[mT5 (base)](https://huggingface.co/google/mt5-base) | 582M | 36.6/22.5 | 10.27 | 58.95/65.32 | 38.73 |
40
- |[BanglaT5](https://huggingface.co/csebuetnlp/banglat5) | 247M | 38.8/25.2 | 13.66 | 68.49/74.77 | 44.18 |
 
 
 
41
 
42
 
43
  The benchmarking datasets are as follows:
44
- * **MT:** **[Machine Translation]()**
45
- * **ATS:** **[Abstractive Text Summarization]()**
46
- * **QA:** **[Question Answering]()**
 
 
 
47
 
48
  ## Citation
49
 
 
34
 
35
  * Supervised fine-tuning
36
 
37
+ | Model | Params | MT (SacreBLEU) | TS (ROUGE-2) | QA (EM/F1) | MD (SacreBLEU-1) | NHG (ROUGE-2) | XLS (ROUGE-2) | BNLG score |
38
+ |--------------------|------------|-----------------------|------------------------|-------------------|--------------------|----------------|----------------|---------------|
39
+ |[mT5 (base)](https://huggingface.co/google/mt5-base) | 582M | 36.6/22.5 | 10.3 | 59.0/65.3 | 17.5 | 9.6 | 2.7/0.7 | 24.9 |
40
+ |[XLM-ProphetNet](https://huggingface.co/microsoft/xprophetnet-large-wiki100-cased) | 616M | 23.3/16.4 | 7.8 | 53.0/57.3 | 20.0 | 9.5 | 6.2/2.7 | 21.8 |
41
+ |[mBART-50](https://huggingface.co/facebook/mbart-large-50) | 611M | 23.6/16.7 | 10.4 | 53.4/58.9 | 18.5 | 11.2 | 5.4/3.7 | 22.4 |
42
+ |[IndicBART](https://huggingface.co/ai4bharat/IndicBART) | 244M | 22.7/13.1 | 8.1 | 53.3/58.8 | 14.8 | 7.9 | 6.3/2.5 | 20.8 |
43
+ |[BanglaT5](https://huggingface.co/csebuetnlp/banglat5) | 247M | 38.8/25.2 | 13.7 | 68.5/74.8 | 19.0 | 13.8 | 6.4/4.0 | 29.4 |
44
 
45
 
46
  The benchmarking datasets are as follows:
47
+ * **MT:** **[Machine Translation](https://github.com/csebuetnlp/banglanmt#datasets)**
48
+ * **TS:** **[Abstractive Text Summarization](https://huggingface.co/datasets/csebuetnlp/xlsum)**
49
+ * **QA:** **[Question Answering](https://huggingface.co/datasets/csebuetnlp/squad_bn)**
50
+ * **MD:** **[Multi Turn Dialogue Generation](https://drive.google.com/file/d/1qPmNN6qA4evbh4cD_BDDTCFOwMu4H2JS/view?usp=sharing)**
51
+ * **NHG:** **[News Headline Generation](https://huggingface.co/datasets/csebuetnlp/xlsum)**
52
+ * **XLS:** **[Cross-lingual Summarization](https://huggingface.co/datasets/csebuetnlp/CrossSum)**
53
 
54
  ## Citation
55