Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: afl-3.0
|
| 3 |
+
language: en
|
| 4 |
+
tags:
|
| 5 |
+
- t5
|
| 6 |
+
datasets:
|
| 7 |
+
- wikipedia
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# cT5-small left-to-right
|
| 11 |
+
|
| 12 |
+
Github: https://github.com/mtreviso/chunked-t5
|
| 13 |
+
|
| 14 |
+
This is a variant of [cT5](https://huggingface.co/mtreviso/ct5-small-en-wiki) that was trained with a left-to-right autoregressive decoding mask. As a consequence, it does not support parallel decoding, but it still predicts the end-of-chunk token `</c>` at the end of each chunk.
|