Update README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
### Usage
|
| 2 |
+
This checkpoint should be loaded into `BartForConditionalGeneration`. [BART docs](https://huggingface.co/transformers/model_doc/bart.html?#transformers.BartForConditionalGeneration)
|
| 3 |
+
|
| 4 |
+
### Metrics for DistilBART models
|
| 5 |
+
|
| 6 |
+
| Model Name | MM Params | Inference Time (MS) | Speedup | Rouge 2 | Rouge-L |
|
| 7 |
+
|:---------------------------|------------:|----------------------:|----------:|----------:|----------:|
|
| 8 |
+
| distilbart-xsum-12-1 | 222 | 90 | 2.54 | 18.31 | 33.37 |
|
| 9 |
+
| distilbart-xsum-6-6 | 230 | 132 | 1.73 | 20.92 | 35.73 |
|
| 10 |
+
| distilbart-xsum-12-3 | 255 | 106 | 2.16 | 21.37 | 36.39 |
|
| 11 |
+
| distilbart-xsum-9-6 | 268 | 136 | 1.68 | 21.72 | 36.61 |
|
| 12 |
+
| bart-large-xsum (baseline) | 406 | 229 | 1 | 21.85 | 36.50 |
|
| 13 |
+
| distilbart-xsum-12-6 | 306 | 137 | 1.68 | 22.12 | 36.99 |
|
| 14 |
+
| bart-large-cnn (baseline) | 406 | 381 | 1 | 21.06 | 30.63 |
|
| 15 |
+
| distilbart-12-6-cnn | 306 | 307 | 1.24 | 21.26 | 30.59 |
|
| 16 |
+
| distilbart-6-6-cnn | 230 | 182 | 1.69 | 20.17 | 29.70 |
|
| 17 |
+
|
| 18 |
+
|