Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ datasets:
|
|
7 |
|
8 |
# Pino (BigBird) base model
|
9 |
|
10 |
-
Dat Nguyen & Yeb Havinga
|
11 |
|
12 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
13 |
|
|
|
7 |
|
8 |
# Pino (BigBird) base model
|
9 |
|
10 |
+
Created by Dat Nguyen & Yeb Havinga
|
11 |
|
12 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
13 |
|